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Recent  Developments  in  the  Robustness  Theory  of  Multivariable  Systems 


The  motivation  for  the  workshop  was  the  dissemination  and  discussion  of 
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FOREWORD 


This  report  summarizes  the  proceedings  of  a  workshop,  "Recent  Develop¬ 
ments  in  the  Robustness  Theory  of  Multivariable  Systems",  held  at  the 
Massachusetts  Institute  of  Technology  (MIT)  on  April  25-27.  The  workshop 
was  the  idea  of  Mr.  D.  Siegel  of  the  office  of  Naval  Research  (ONR) .  It 
was  organized  by  Messrs.  D.  Siegel  and  R.  Von  Husen  of  ONR;  and  Profs. 

N.R.  Sandell  Jr.,  G.  Stein,  and  M.  Athans,  Mr.  R.A.  Osborne,  and  Mrs.  F. 
Frolik,  all  of  M.I.T.  To  promote  informal  interaction,  attendance  was 
strictly  limited  to  researchers  actively  working  in  the  subject  area 
of  the  workshop  (narrowly  defined)  along  with  several  research  managers 
and  a  number  of  practicing  engineers. 

The  tangible  output  of  the  conference  is  this  final  report.  However, 
the  editor  firmly  believes  that  the  intangible  benefits  of  the  three 
days  of  intense  discussion  focused  on  the  extremely  important  conference 
theme  represent  the  most  important  output.  Discussions  with  the  workshop 
participants  give  some  indication  of  the  nature  of  these  benefits.  The 
practitioners  seemed  to  gain  an  appreciation  for  the  formal  procedures 
described  for  the  quantitative  evaluation  of  robustness;  the  remarks  of 
one  engineer  who  indicated  that  he  was  going  to  go  back  and  check  the 
stability  margins  on  an  optimal  linear-quadratic  regulator  design  he  was 
carrying  out  were  typical .  The  research  managers  were  exposed  to  several 
possible  new  directions  for  the  programs  they  sponsor,  and  several  indicated 
interest  in  pursuing  those  directions.  The  researchers  in  attendence 
gained  a  renewed  appreciation  for  the  robustness  issue  and  a  number  of 
promising  ideas  were  developed.  The  control  engineering  profession,  and 
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1.  INTRODUCTION 


1.1  Motivation 

The  motivation  for  the  ONR/MIT  Workshop  on  Recent  Developments  in  the 
Robustness  Theory  of  Multivariable  Systems  was  well -illustrated  by  the 
opening  remarks  of  Mr.  R.  Von  Husen  of  the  Office  of  Naval  Research  (ONR) . 
Mr.  Von  Husen  noted  that  the  Navy  has  in  the  past  been  delivered  aircraft 
with  unacceptable  handling  qualities  in  certain  regions  of  their  flight 
envelopes.  This  problem  illustrates  in  a  general  way  the  conference 
theme  of  design  of  robust  feedback  control  systems,  i.e.,  systems  that 
continue  to  satisfy  their  performance  requirements  dispite  variations 
between  the  design  model  and  the  actual  system  dynamics. 

The  problems  raised  by  Mr.  Von  Husen  illustrate  the  conference  theme 
in  a  much  more  specific  sense  as  well.  There  are,  of  course,  military 
specifications  on  the  design  of  flight  control  systems  for  piloted  air¬ 
craft  [20] .  Among  other  requirements,  a  feedback  control  Systran  must 
have  certain  gain  and  phase  margins  in  order  to  be  acceptable.  To  quote 
from  [20] , 

"Stability  margins  are  required  for  FCS  to  allow  for  variations 
in  system  dynamics.  Three  basic  types  of  variations  exist: 

Math  modeling  and  data  errors  in  defining  the  nominal  system 
and  plant. 

Variations  in  dynamic  characteristics  caused  by  changes  in 
environmental  conditions,  manufacturing  tolerances,  aging, 
wear,  noncritical  material  failures,  and  off-nominal  power 
supplies. 


Numbers  in  brackets  refer  to  references  listed  at  the  end  of  the  report. 
References  1-19  are  included  in  Appendix  C. 
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It  would  seem  from  the  above  quotation  that  the  robustness  issue 


is  well-understood  from  the  viewpoint  of  classical  frequency  domain 


systems.  However 


for  multiple-loop  systems.  To  quote  again  from  [20] 


"In  multiple-loop  systems,  variations  shall  be  made  with  all  gain 
and  phase  values  in  the  feedback  paths  held  at  nominal  values  except 
for  the  path  under  investigation." 


The  fundamental  difficulty  with  this  approach  is  that  it  fails  to  check 


for  simultaneous  gain  and  phase  variations  in  several  paths.  Of  course 


real-world  model  uncertainty  cannot  be  expected  to  nicely  confine  itself 


to  a  single  loop  of  the  system!  In  fact,  for  a  flight  control  system 


the  dominant  variation  is  due  to  the  change  in  control  surface  effective 


ness  with  dynamic  pressure,  which  manifests  itself  as  a  change  in  the  gains 


of  the  transfer  functions  from  control  surface  deflections  to  the  response 


variables  of  interest.  The  dynamic  pressure  variation  is  due  to  changes 


The  recent  conceptual  breakthrough  that  provided  the  motivation 


for  the  Conference  is  the  development  of  techniques  that  can  satisfactorily 


test  the  robustness  of  multivariable  systems.  The  breakthrough  is  not 


so  much  from  the  point  of  view  of  mathematical  theory  (although  see 


for  some  time  [22] .  Rather  the  breakthrough  has  been  the  point  of  view 


of  applications,  where  it  is  becoming  clear  that  modern  input -output 


stability  theory  can  be  used  to  develop  what  are  essentially  multivariable 


stability  margins.  This  development  is  clearly  of  considerable  practical 
importance,  for  aircraft  flight  control  systems  as  well  as  for  other 
multivariable  control  systems. 


1.2  Overview  of  Report 

The  remainder  of  this  report  is  organized  as  follows. 

In  Section  2,  we  will  give  a  brief  description  of  the  recent  develop¬ 
ments  in  the  robustness  theory  of  multivariable  systems  that  motivated 
the  workshop.  We  will  begin  by  describing  various  characterizations 
of  the  robustness  of  multivariable  linear  systems  that  generalize 
classical  stability  margin  definitions.  Then  we  will  describe  the 
relationship  of  these  characterizations  to  the  robustness  properties 
of  linear -quadratic -Gaussian  (LQG)  optimal  controllers. 

In  Section  3,  we  will  briefly  summarize  the  workshop  proceedings. 

We  will  attempt  to  indicate  the  nature  of  the  presentations  by  the 
participants,  and  to  recapitulate  the  viewpoints  expressed  in  the  round¬ 
table  discussion  at  the  end  of  the  workshop. 

The  final  workshop  program  is  given  in  Appendix  A,  and  a  list  of 


attendees  is  provided  in  Appendix  B.  Appendix  C  contains  preprints 


and  reprints  of  the  papers  presented. 


2 .  BACKGROUND 


2 . 1  Robustness  Characterizations 

An  important  theme  in  system  theory  is  the  preservation  of  various 
system  theoretic  properties  in  the  face  of  variations  in  the  system 
model.  It  is  possible  to  distinguish  two  variations  on  this  theme. 

In  the  first,  attention  is  restricted  to  infinitesimal  changes  in  the 
parameters  of  the  nominal  system  model.  Thus  one  may  begin  by  assuming 
that  the  nominal  system  has  a  certain  property  and  then  ask  if  there 
exists  an  open  set  about  the  nominal  model  parameters  such  that  all  the 
systems  with  parameters  in  this  set  have  the  desired  property.  Al¬ 
ternatively,  one  may  seek  a  relationship  between  an  infinitesimal  vari¬ 
ation  in  a  nominal  system  parameter  and  the  corresponding  change  in 
some  system  property.  We  will  refer  to  investigations  of  this  first 
type  as  sensitivity  theory.*  A  second  approach  requires  the  explicit 
delineation  of  finite  regions  of  models  about  the  nominal  model  for 
which  some  given  property  is  preserved.  We  will  refer  to  investigations 
of  this  second  type  of  robustness  theory. 

Within  the  context  of  sensitivity  or  robustness  theory,  there  are 
several  properties  that  have  been  investigated.  For  example,  it  is 
well  known  that  the  controllability  property  is  insensitive  to  small 
parameter  variations  (see  (23,  p.43]  for  a  precise  statement).  As 
another  example,  it  is  well  known  that  type  1  servomechanisms  have 

'''There  is  an  extensive  literature  on  this  subject,  which  will  not  be 
discussed  further.  See,  e.g.,  (25]  for  a  collection  of  ’"any  of  the 
most  important  papers  on  sensitivity  theory. 
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zero  steady  state  step  tracking  error  despite  large  (but  not  destabilizing) 
variations  in  their  transfer  function  matrices  [24] .  The  workshop 
proceedings  described  in  this  report  were  concerned  with  the  robustness 
of  the  stability  property  cf  multivariable  systems.  This  topic  provided 
a  coherent  focus  for  the  workshop,  and  moreover  it  was  felt  that 

i)  stability  is  the  most  fundamental  requirement  of  a  feed¬ 
back  system,  and 

ii)  practical  feedback  systems  must  remain  stable  in  the  face 
of  large  parameter  variations. 

The  importance  of  obtaining  robustly  stable  feedback  control  systems 
has  long  been  recognized  by  designers.  Indeed,  a  principal  reason  for 
using  feedback  rather  than  open  loop  control  is  the  presence  of  model 
uncertainties.  Any  model  is  at  best  an  approximation  of  reality,  and 
the  relatively  lower  order,  linear,  time -invariant  models  most  often  used 
for  controller  synthesis  are  bound  to  be  rather  crude  approximations. 

More  specifically,  a  given  system  model  can  usually  be  characterized 
as  follows.  There  is  a  certain  range  of  inputs  typically  bounded  in 
amplitude  and  in  rate  of  change  for  which  the  model  gives  a  reasonable 
approximation  to  the  system.  Outside  of  this  range,  due  to  neglected 
nonlinearities  and  dynamic  effects,  the  model  and  system  may  behave  in 
grossly  different  ways.  Unfortunately,  this  range  of  permissible  inputs 
is  rarely  spelled  out  explicitly  along  with  the  model,  but  is  rather 
implicit  in  the  technology  that  the  model  came  from  -  there  is  no  "truth 
in  modeling"  law  in  systems  theory.  This  situation  has  led  to  great  fun  - 
as  practitioners  examine  the  paper  designs  of  theoreticians  -  as  well  as 
serious  consequencies  in  which  a  spacecraft  is  unstable  because  of  the 
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interaction  of  its  flexure  modes  with  a  controller  designed  on  the  basis 
of  a  rigid  body  model.1 

In  classical  frequency  domain  techniques  for  single-input,  single¬ 
output  (SISO)  control  system  design,  the  robustness  issue  is  naturally 
2 

handled.  These  techniques  employ  various  graphical  means  (e.g..  Bode, 
Nyquist,  inverse-Nyquist,  Nichols  plots)  of  displaying  the  system  model 
in  terms  of  its  frequency  response.  From  these  plots,  it  is  automatic 
to  determine  by  inspection  the  minimum  change  in  the  model  frequency 
response  that  leads  to  instability. 

Commonly  used  measures  of  the  closeness  of  a  SISO  feedback  system  to 
instability  are  its  gain  and  phase  margins.  The  margins  are  defined  with 
reference  to  Fig. 2.1-1.  Here  the  nominal  feedback  system  (with  a  =  1)  is 
assumed  stable.  The  positive  phase  margin  is  the  smallest  value  of 
greater  than  zero  such  that  the  system,  of  Fig.  2.1-1  with  a  ( jco)  =  e^  is  un¬ 
stable.  The  negative  phase  margin  is  defined  in  an  analogous  fashion. 

The  upward  gain  margin  is  the  smallest  value  of  a  =  constant  >  1  for 
which  the  system  is  unstable  (usually  expressed  in  decibels  with  respect 
to  a  =  +1),  and  the  downward  gain  margin  is  similarly  defined.  The  notions 
of  gain  and  phase  margins  have  gained  such  widespread  acceptance  that  as 
described  earlier,  they  have  been  incorporated  into  the  military  speci- 

1This  phenomenon  is  by  no  means  specific  to  aerospace  applications.  The 
subsynchronous  resonance  phenomenon  in  electric  power  system  control  is 
another  excellent  example. 

2 

See  the  fundamental  work  of  Bode  [26J,  and  any  good  classical  textbook, 
but  especially  (27] . 


fications  for  aircraft  flight  control  systems 


There  are  several  considerations  involved  in  gain  and  phase  margins 


as  characterizations  of  robustness.  First,  in  theory  these  margins  are 


not  adequate  measurements  of  robustness,  since  a  system  could  conceivably 


have  large  gain  and  phase  margins  but  be  destabilized  by  an  arbitrarily 


small  simultaneous  variation 


This  fact  is  not  too 


serious  when  considered  in  the  context  of  classical  SISO  frequency  domain 


techiques  as  it  is  easily  detected,  but  it  does  point  out  a  potential 


limitation  of  these  robustness  measures  considered  in  isolation.  Second 


the  requirement  for  gain  and  phase  margins  depends  on  the  degree  of  model 


for  example,  it  is  often  specified  that  a  flight  control  system  should  be 


'gain  stable"  (phase  margins  =  +  180°)  at  frequencies  in  the  vicinity  of 


classical  frequency  domain  stability  plots.  For  the  unit  feedback 


system  of  Fig.  2.1-2,  Fig.  2.1-3  illustrates  the  Nyquist  stability  criterion 


and  Fig.  2.1-4  shows  how  gain  and  phase  margins  can  be  determined  from  the 


Nyquist  diagram.  But  more  important  that  its  role  in  determining  gain 


and  phase  margins  is  the  visual  insight  that  a  designer  can  obtain  from 


such  a  diagram.  Assuming  that  the  diagram  indicates  that  the  nominal 


system  is  stable,  a  change  in  the  loop  transfer  function  that  changes 


the  number  of  encirclements  of  the  critical  point  (-1,0)  will  lead  to 


instability.  Thus,  nearness  to  the  critical  point  indicates  closeness 


This  statement  assumes  that  the  number  of  open-loop  unstable  roles  re 
mains  constant. 
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to  instability.  This  observation  is  important,  as  we  will  see,  since  the 
notion  of  distance  to  the  critical  point  generalizes  nicely  to  the  multi- 
variable  case,  while  the  usual  definitions  of  gain  and  phase  margins  do 
not. 

We  can  formalize  the  foregoing  observations  as  follows.  Consider 
the  single-input,  single-output  unity  feedback  system  illustrated  in  Fig. 
2.1-2,  where  the  transfer  function  g(s)  is  a  representation  of  the  plant 
plus  any  compensation  that  has  been  employed.  We  suppose  that  the  un¬ 
certainty  in  the  representation  of  the  plant  is  modeled  as  an  additive 
(Fig.  2.1-5)  or  multiplicative  (Fig.  2.1-6)  perturbation  to  g(s).  We 
assume  that  the  nominal  feedback  system  is  stable,  as  are  the  perturbations. 

Consider  the  additive  case  first.  We  are  given  that  the  nominal 
feedback  loop  is  stable,  so  that  the  Nyquist  plot  of  g(s)  has  the  correct 
number  of  encirclements  of  the  -1  point  for  stability  to  be  concluded. 

As  long  as  the  perturbed  Nyquist  plot  has  the  same  number  of  encirclements, 
the  perturbed  feedback  loop  will  remain  stable.  Clearly,  a  sufficient 
condition  for  this  to  occur  is  that  (Fig.  2.1-7) 

| Ag ( j(o)  |  <  |l  +  g(jco)  |  (2.1-1) 

for  all  0)  >  0.  Notice  that  this  condition  is  expressed  in  terms  of  the 
magnitude  of  the  return  difference  transfer  function  of  the  nominal  feed¬ 
back  loop,  1  +  g(s). 

The  multiplicative  version  of  this  result  is  very  similar,  with 
Ag(s)  replaced  by  g(s)  Ag(s).  The  sufficient  condition  is 


|g(jw)  Ag  ( jco)  |  <  |l  +  g(jo>)| 


(2.1-2) 


for  all  (0  >_  0,  which  can  be  expressed  in  the  form 

|  Ag  ( jOJ)  |  <  |l  +  g  1  <jco)  [  .  (2.1-3) 

Note  that  the  condition  in  this  case  is  expressed  in  terms  of  the  inverse 

of  the  closed  loop  transfer  function  ~ . 

1+g  (s) 

There  is  a  multivariable  generalization  of  Nyguist's  theorem  (28] 
that  is  useful  in  extending  the  preceding  discussion  to  the  multivariable 
case.  However,  as  we  will  see,  information  concerning  system  robustness 
in  general  cannot  be  obtained  directly  from  inspection  of  the  multivariable 
Nyquist  diagram. 

The  multivariable  Nyquist  theorem  requires,  for  closed  loop  stability, 
that  the  number  of  counterclockwise  encirclements  of  the  origin  by  the 
Nyquist  locus  of  det(I  +  G(jw)),  where  G(jcd)  is  the  loop  transfer  matrix, 
should  equal  the  number  of  open -loop  poles  that  are  unstable.'*’  The 
trouble  with  this  result  from  the  robustness  point  of  view  is  the  dependence 
on  the  determinent.  Just  as  it  is  not  possible  to  tell  how  close  a 
matrix  is  to  being  singular  by  size  of  its  determinent  (see,  e.g.,  [29]), 

so  it  is  not  possible  to  tell  how  close  a  system  is  to  instability  from 

2 

its  multivariable  Nyquist  plot  .  This  comment  applies  also  to  closely 

’''This  result  clearly  generalizes  the  classical  Nyquist  theorem.  For  a 
scalar  transfer  function  G(s), 

det  (1+  G(j6>))  =  1  +  G(jw) 

and  the  number  of  encirclements  of  the  origin  by  1  +  G(jco)  is  equal  to 
the  number  of  encirclements  of  the  -1  point  by  G(jw). 

2 

There  is  a  deep  connection  between  these  two  facts,  see,  e.g.,  [2]. 


related  multivariable  stability  plots  such  as  the  inverse  Nyquist  array 
[28]  and  characteristic  loci  method  [30].  The  nature  of  the  difficulty 
is  illustrated  by  the  following  example,  from  [31] . 

Example: 


Fig.  2.1-8 


Internal  Structure  of  Example 
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Fig.  2,1-10  Multivariable  Nyquist  Diagram 
Note  that  the  diagram  is  completely  independent  of  the  value  of  b^2 • 

However,  as  b becomes  large,  the  system  is  nearly  unstable  in  the 
following  sense.  If  we  perturb  G(s)  to  obtain  (Fig.  2.1-11) 


G  (s)  = 


12 

s 


21 


1 

s 


(2.1-11) 


then  the  closed-loop  system  is  unstable  for  b^  > 


1_ 

12 


(This  is  readily 

seen  from  the  state  equations) .  If  b^2  is  very  large,  then  b^  can  be 
very  small  so  that  a  small  change  in  the  system  dynamics  results  in  an 
unstable  system.  This  situation  cannot  be  detected  by  examination  of 


Fig.  2.1-11  Perturbed  System 


the  multivariable  Nyquist  diagram  for  the  nominal  system. 

The  difficulty  we  have  uncovered  can  be  explained  as  follows:  A 

multivariable  system  will  be  sensitive  to  modeling  errors  if  its  return 

difference  matrix  I  +  G(jco)  is  nearly  singular  at  some  frequency  CO  , 

c 

since  then  a  snail  change  in  will  make  I  +  GljoO  exactly  singular 

When  this  happens,  det  [I  +  G(jco  )]  =  0  and  the  number  of  encirclements 

c 

changes.  Unfortunately,  near  singularity  of  a  matrix  cannot  be  detected 
by  the  size  of  its  determinant.  A  simple  example  is 
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which  can  be  made  singular  with  a  small  perturbation  in  its  (2,1)  element. 


Reliable  detection  of  near  singularity  of  a  matrix  requires  computations 
involving  its  norm,  as  we  will  see  later  on. 

From  the  above  example,  we  can  see  that  the  problem  of  determining 
a  characterization  of  the  robustness  of  a  multivariable  feedback  system, 
i.e.,  its  distance  from  instability,  is  of  fundamental  importance.  Several 
authors  [32]  -  [35] ,  [12]  have  considered  this  issue  in  the  context  of 
characterizing  the  robustness  properties  of  a  linear-quadratic  (LQ)  opti¬ 
mal  regulator  with  respect  to  nondynamical  model  variations  (see  the  next 
section).  However,  the  basic  work  is  this  area  is  due  to  Safonov  [3], 

[36]  -  [37]  who  generalized  an  approach  of  Zames  [38]  -  [39] .  Safonov 
considers  system  models  to  be  specified  by  relations  between  function 
spaces,  as  is  now  standard  in  the  modern  input-output  formulation  of 
stability  theory.1  He  has  developed  a  sector  stability  criterion  that 
allows  one  to  prove  stability  not  just  for  a  single  feedback  system, 
but  a  family  of  systems  comprised  of  subsystems  each  of  which  lie  within 
certain  bounds  about  a  nominal  model.  In  the  case  of  linear,  time  invariant 
subsystems,  these  bounds  are  characterized  in  terms  of  their  transfer 
function  matrices. 

We  will  consider  here  a  very  special  case  of  Safonov's  characterization, 
1See,  e.g.,  [40]  or  [41]  . 
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derived  in  [1],  [2],  [7]\  We  consider  the  multivariable  unity  feedback 
system  illustrated  in  Fig.  2.1-12,  where  the  transfer  function  matrix 
G(s)  is  a  representation  of  the  plant  plus  any  compensation  that  has  been 
employed.  We  suppose  that  the  uncertainty  in  the  representation  of  the 
plant  is  modeled  as  an  additive  (Fig.  2.1-13)  or  multiplicative  (Fig.  2.1-14) 
perturbation  to  G(s).  We  assume  that  the  nominal  feedback  system  is 
stable,  as  are  the  perturbations. 

Consider  the  additive  case  first.  We  are  given  that  the  nominal 
feedback  system  is  stable  so  that  the  multivariable  Nyquist  plot  of 
det(I  +  G ( jo) ) )  has  the  correct  number  of  encirclements  of  the  origin 
for  stability  to  be  concluded.  As  long  as  the  perturbed  multivariable 
Nyquist  plot  has  the  same  number  of  encirclements,  the  perturbed  feed¬ 
back  loop  will  remain  stable.  It  turns  out  that  a  sufficient  condition 
for  this  to  occur  is  that 


||AG(j  )1|  <  — - - - IT- -  (2.1-13) 

I  I  (1  +  G(jO)))  |  | 

for  all  (o  >_  0,  where  |  |  •  |  |  is  an  appropriate  matrix  norm  (see  [7] )  . 

Since  in  the  scalar  case,  the  norm  reduces  to  the  absolute  value,  (2.1-13) 
is  the  multivariable  generalization  of  (2.1-1).  Notice  that  this  con¬ 
dition  is  expressed  in  terms  of  the  norm  of  the  inverse  return  dif¬ 
ference  transfer  function  matrix,  |  |  (I  +  G(s))  1  (  |  . 


^Doyle  [1]  considered  the  linear  finite  dimensional  case  and  the  spectral 
norm,  while  Sandell[2]  gave  a  more  general  proof  valid  for  infinite 
dimensional  systems  (e.g. ,  systems  with  time  delays)  and  nonlinear 
perturbations,  and  Laub  [7]  extended  the  result  to  more  easily  computed 
norms. 
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The  multiplicative  version  of  this  result  is  very  similar.  A  suf¬ 
ficient  condition  for  the  perturbed  feedback  system  of  Fig.  2.1-14  to 
remain  stable,  given  that  the  nominal  feedback  system  of  Fig.  2.1-12  and 
the  perturbation  Ag(s)  are  stable,  is 

|  |  AG  ( jou)  I  |  <  - - — -  (2.1-14) 

i  |  (I  +  G  ( j0>) )  |  1 

for  all  co  >_  0.  Notice  that  this  condition  is  specified  in  terms  of  the 
closed-loop  frequency  response  matrix, 

(I  +  G-1(jco))_i  =  (I  +  G(jco))_1G(jco)  . 

The  conditions  (2.1-13)  and  (2.1-14)  are  relatively  straightforward 

to  test  graphically.  Computational  details  are  discussed  in  [7] .  Plots 

for  several  academic  and  physical  examples  are  given  in  [1] ,  [18] ,  and 

[19].  In  interpreting  these  plots,  it  is  useful  to  keep  in  mind  that 

the  plot  of  - - - -rr -  reduces  in  the  scalar  case  to  the  Bode 

|  |  (I  +  G(jco))  || 

magnitude  plot  of  the  return  difference  transfer  function  1  +  g(jco). 

Similarly,  the  plot  of  - ^ - r —  reduces  to  the  Bode  magnitude 

|  |  (I  +  G  (jO)))"1)  | 

plot  of  the  inverse  frequency  response  1  +  g  1  (jto) .  Unfortunately,  there 
is  as  yet  no  totally  satisfactory  notion  of  phase  to  go  along  with  the 
magnitude  plots  -  although  see  [1]  for  some  ideas. 

It  is  premature  to  state  that  the  conditions  (2.1-13)  and  (2.1-14) 
provide  the  sought  after  notion  of  multivariable  stability  margin.  These 
are  only  sufficient  conditions,  and  may  prove  overly  conservative  in 
practice.  More  experience  is  needed  to  verify  that  it  is  possible  to  spot 


potential  instabilities  in  physical  systems  that  cannot  be  readily  detected 
by  other  means.  However,  it  is  certainly  true  that  the  quantities 


- - -  and  - - - r -  reduce  in  the  scalar  case  to 

|  |  (I  +  G  ( jco) )  '-*■  (  |  1  |  U  +  | 

quantities  that  seem  to  capture  the  essence  of  the  notion  of  robustness 
in  classical  control  system  design  -  namely,  the  distance  as  a  function  of 
frequency  to  the  critical  point  of  the  Nyquist  and  inverse  Nyquist  Loci, 
respectively. 

Another  difficulty  is  that  very  little  is  known  at  present  about 

how  to  shape  the  quantities  - - - , —  and  - r - ; 

|  I  (I  +  G(jO)))-1|i  |  |  (I  +  G_1  ( j(0)  )  _1 1  1 

using  established  multivariable  design  methodologies  such  as  pole  placement 
or  characteristic  loci.  An  exception  to  this  statement  is  the  linear- 
quadratic-Gaussian  (LQG)  approach;  the  robustness  properties  of  the  LQG 
problem  are  our  next  topic  of  discussion. 

2.2  Robustness  of  LQG  Designs 

In  modern  multivariable  techniques  for  control  system  design,  the 
robustness  issue  has  been  largely  neglected,  with  interest  picking  up 
only  recently.  An  exception  to  this  statement  is  an  early  and  basic  paper 
of  Kalman  [42]  on  the  properties  of  single-input  steady-state  linear- 
quadratic  optimal  regulators.  Kalman  established  the  fundamental  in¬ 
equality 

|l  +  gT ( jail  -  A)  ~1b|  :>  1  (2.2-1) 

for  the  return  difference  function  of  an  L Q  regulator.*-  This  inequality 

*"This  equality  is  valid  only  when  there  are  no  crossterms  between  the  state 
and  control  variables  in  the  quadratic  cost  functional.  In  this  equation 
gT  is  the  optimal  feedback  gain  matrix. 


proves  that  the  Nyquist  plot  of  the  loop  transfer  function  of  an  LQ  regu¬ 
lation  (see  Fig.  2.2-1)  avoids  the  unit  disc  about  the  critical  point  -1  +  jO 
(Fig.  2.2-2).  Consequently,  as  pointed  out  in  [43],  every  single-input 
LQ  regulator  has  +  60°  phase  margin,  infinite  (positive)  gain  margin,  and 
50%  gain  reduction  tolerance.  The  Nyquist  plot  for  a  typical  example  [44] 
is  shown  in  Fig.  2.2-3. 

Taken  at  face  value,  the  guaranteed  margins  of  an  LQ  controller  are 
quite  impressive.  Indeed,  the  Military  Specifications  are  almost^  satisfied 
automatically!  However,  there  are  some  limitations  associated  with  this 
result.  First,  while  the  guarantees  are  adequate  for  model  uncertainty 
within  the  basic  frequency  range  for  which  the  design  model  is  valid, 
they  may  be  grossly  inadequate  at  higher  frequencies.  For  example,  common 
practice  is  to  require  gain  stability  (i.e.,  phase  margin  =  +  180°)  at 
frequencies  higher  than  a  specified  cut-off  frequency.  Second,  as  we  will 
see,  the  gain  and  phase  margin  guarantees  do  not  apply  if  a  Kalman  filter 
or  other  state  reconstructor  is  inserted  in  the  loop.  Third,  the  property 
is  somewhat  of  an  idealization  of  reality,  since  the  Nyquist  plot  of  a 
physical  transfer  function  cannot  avoid  the  unit  circle  at  sufficiently 
high  frequencies. 

This  last  point  requires  elaboration,  for  it  has  been,  in  our  opinion, 
the  source  of  some  confusion  in  the  literature.  It  is  possible  to  show, 
on  very  general  theoretical  grounds,  that  the  loop  transfer  function 
of  any  physically  realizable  feedback  system  must  have  at  least  a  two 

^The  Military  Specifications  require  +  8  db  gain  margin  at  frequencies 
exceeding  the  first  aeroelastic  mode. 
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Fig.  2.2-1  The  LQ  Loop  Transfer  Function  is  Defined  From  u'  to  u" 


Fig.  2.2-2  Disk  About  Unit  Circle  Avoided  by  Optimal  Nyquist  Locus 


Fig.  2.2-3  Nyquist  Plot  for  LQ  Design 


pole  rolloff. ^  Thus  its  asymptotic  phase  will  be  at  least  -180°,  and  its 
Nyquist  plot  must  therefore  penetrate  the  unit  circle,  in  contradiction 
to  Kalman's  result. 

The  resolution  of  this  contradiction  is,  of  course,  Kalman's  assumption 
of  full  state  feedback,  which  is  a  mathematical  idealization  that  can 
never  be  exactly  achieved  in  practice.  There  are  always  unmodeled  dyna¬ 
mics  in  any  physical  system  which  at  some  sufficiently  high  frequency  will 
contribute  the  additional  phase  and  attentuation  predicted  by  Bode’s 
theorem. 

This  objection  to  Kalman's  result  is  not  too  serious  as  long  as  the 

Nyquist  locus  of  the  real  system  penetrates  the  unit  circle  close  to  the 

origin,  where  the  loop  gain  is  low.  Then  the  gain  and  phase  margins 

predicted  by  (2.2-1)  will  be  close  to  the  actual  margins.  This  will 

normally  be  the  case  when  the  unmodeled  dynamics  are  well -separated  in 

frequency  from  the  dynamics  given  by  the  state  space  model  used  for  design, 

2 

and  when  the  bandwidth  of  the  loop  transfer  function  is  not  too  high. 

The  potential  pitfall  is  that  with  modern  design  methods  (including  pole 
placement  and  characteristic  loci  as  well  as  LQ  methods) ,  it  is  easy  to 
achieve  a  very  high  speed  of  response  (for  the  design  model) ,  but  at 
the  expense  of  obtaining  an  unrealistically  high  bandwidth.  Comparison 
of  closed-loop  eigenvalue  locations  with  the  locations  of  poles  of 
suspected  unmodeled  dynamics  can  help  to  avoid  this  situation,  but  there 
^See  [45]  for  an  argument  based  on  a  theorem  of  Bode. 

2 

It  may  not  be  possible  to  always  achieve  this  condition,  as  the  example 
of  a  space  structure  with  many  flexure  modes  close  to  its  rigid  body 
modes  shows. 
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seems  to  be  no  wholly  satisfactory  technique  txirely  in  the  time  domain. 

To  summarize  our  discussion  of  Kalman's  result  on  the  robustness  of 
single-input  LQ  regulators,  it  suffices  to  say  that  the  guaranteed  properties 
are  very  good,  but  that  the  loop  transfer  function  must  be  checked  to  in¬ 
sure  that  the  gain  crossover  frequency  is  not  too  high. 

Turning  now  to  the  multi-input  case,  the  situation  is  less  clear  cut 
and  still  in  flux. *  There  have  been  several  attempts  at  generalizing  Kalman's 
result  to  the  multi-input  case,  [32]  -  [35],  [12]  but  the  most  definitive 
results  are  due  to  Safonov  and  Athans  [13] .  They  have  given  a  condition 
that  characterizes  a  class  of  perturbations  for  which  multi-input  LQ  regu¬ 
lators  are  guaranteed  to  remain  stable.  These  perturbations  include,  for 
the  case  of  a  diagonal  control  weighting  matrix  in  the  quadratic  cost 
function, 

•simultaneous  phase  perturbations  of  up  to  +  60°  in  each 
input  channel,  or 

♦simultaneous  gain  perturbations  from  50%  of  nominal  to 
infinity  in  each  input  channel. 

j<f>i 

These  perturbations  are  illustrated  in  Fig.  2.2-4,  in  which  =  e  , 

1  <#>  J  60°,  for  phase  variations  or  ^  <  a,  <  »  for  gain  variations. 

It  has  recently  been  shown  [46]  that  Savonov  and  Athans'  result  can  be 
derived  more  simply  from  the  multivariable  Nyquist  Theorem,  using  the 

^or  example,  Lehtomaki  [46]  has  just  obtained  an  example  of  a  multi¬ 
input  LQ  regulator  with  an  infinitesimally  small  gain  margin.  The 
control  weighting  matrix  in  this  example  is  nondiagonal,  so  the  results 
of  [13]  are  not  contradicted. 


Fig.  2.2-4  Configuration  for  Definition  of  Multi-Input  LQ  Stability  Margins 


multi-input  version 


[I  +  G(-jOJl  -  A)~1B]Tn[I  +  G  ( j(Jl  -  A)-1B]  >_  R  (2.2-2) 

of  (2.2-1).  Moreover,  one  can  show  from  (2.2-2)  that  the  inequality1 

1  1 

- ^ ; -  >  Vr-TH"  (2.2-3) 

|  |  (I  +  G  ( jOJI  -  A)  _1B)  _1 1  L 

K 

holds,  and  (2.2-3)  together  with  (2.1-13)  shows  that  the  LQ  regulator  has  a 
degree  of  tolerance  to  additive  perturbations  of  the  type  considered  in 
the  previous  Section.  A  similar  result  can  be  obtained  in  the  multipli¬ 
cative  case  [47] ,  [48] . 

Thus  we  see  that  generalizations  of  the  single-input  LQ  stability 
margin  results  have  been  obtained,  although  the  situation  is  naturally 
somewhat  more  complicated  in  the  multi-input  case.  Similar  comments  to 
those  made  in  the  single-input  case  pertain  concerning  the  idealizations 
implicit  in  these  results;  for  physically  realizable  feedback  systems  the 
condition  (2.2-2)  must  be  violated  at  sufficiently  high  frequencies. 

Of  course,  in  very  many  cases  it  is  not  a  particularly  good  approxi¬ 
mation  to  assume  that  all  state  variables  can  be  perfectly  measured.  In 
these  cases,  it  is  necessary  to  invoke  the  separation  theorem  and  to  use 
a  Kalman  filter  to  reconstruct  the  state  variables,  thus  obtaining  a  so- 
called  LQG  (linear -quadratic-Gaussian)  design  [49] .  Of  course,  the  Kalman 

^IMI  is  the  matrix  norm  induced  by  the  vector  norm  ]  |x]  =  x*Rx{*  = 

R  R 

conjugate  transpose ) . 
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filter  explicitly  incorporates  a  model  of  the  system  in  its  computations, 
and  it  might  be  expected  that  an  LQG  design  would  have  much  poorer  robustness 
properties  than  the  corresponding  LQ  design.1  This  is  indeed  the  case  - 
there  are  no  guaranteed  margins  for  LQG  feedback  controllers,  as  has  been 
shown  by  counter  example  [50] .  The  example  in  [50]  is  of  course  pathologi¬ 
cal,  but  poor  stability  margins  can  occur  in  actual  LQG  designs.  Fig.  2.2-5 
shows  a  design  reported  in  the  literature  [44]  that  has  less  than  10°  of 
phase  margin. 

2 

Fortunately,  there  are  two  dual  procedures  [14] ,  [15]  for  "robustness 
recovery",  i.e.,  for  systematically  adjusting  an  LQG  design  to  asymptotically 
obtain  the  LQ  stability  margins.  In  one  procedure  [14] ,  the  state  feed¬ 
back  gains  are  adjusted  to  take  account  of  the  fact  that  state  estimate 
feedback  is  being  used;  in  the  other  [15] ,  the  Kalman  filter  is  adjusted 
to  take  account  of  the  fact  that  it  is  being  used  in  a  feedback  loop. 

Thus  the  robustness  issue  can  be  fairly  directly  handled  with  the  LQG 
approach. 

Fig.  2.2-6,  shows  a  robustified  version  of  the  LQG  design  in  [44]. 
Stability  margins  are  now  quite  satisfactory.  However,  it  should  be 
pointed  out  that  more  measurement  noise  is  passed  in  this  design  than  in 
the  "optimal"  design  given  by  the  separation  theorem,  so  that  there  is 

^It  can  be  shown  that  the  LQG  design  is  robust  to  errors  in  the  model 
used  to  compute  its  Kalman  filter  gain  -  as  distinct  from  the  model 
used  in  the  on-line  filtering  operations  [51]. 

2 

However,  these  procedures  only  apply  to  minimum  phase  plants,  i.e., 
plants  with  no  right  half  plane  transmission  zeroes. 


a  higher  ms  level  of  variation  in  the  state  variables. 

In  [52],  the  results  of  [14]  and  [15]  are  extended  to  the  case  in  which 
a  minimal  order  observer  is  used  instead  of  a  Kalman  filter  to  generate 
state  estimates  for  feedback.  In  this  thesis,  an  interesting  example  of 
a  design  problem  for  an  intertially  stable  platform  (due  to  Dr.  S.  W. 

Gully)  is  treated  which  shows  the  necessity  of  multiloop  compensation 
to  obtain  a  stable  feedback  system  with  extremely  high  bandwidth. 


3.  WORKSHOP  PROCEEDINGS 


In  the  preceding  section  we  described  some  recent  results  con¬ 
cerning  the  characterization  of  robustly  stable  multivariable  feedback 
systems,  and  we  discussed  the  relation  of  these  results  to  the  LQG  design 
methodology.  These  results  motivated  the  ONR/MIT  Workshop  on  Recent 
Developments  in  the  Robustness  Theory  of  Multivariable  Systems.  The  papers 
presented  and  the  discussions  held  are  very  briefly  summarized  in  this 
section;  the  papers  are  included  in  Appendix  C. 

3.1  Introduction  to  Papers 

The  papers  presented  in  the  first  day  were  concerned  with  characteriz¬ 
ing  the  robustness  of  multivariable  feedback  systems  with  respect  to  model 
uncertainty. 

The  first  paper  was  given  by  Mr.  J.C.  Doyle  [1],  Mr.  Doyle  con¬ 
sidered  the  case  of  a  finite  dimensional  linear  multivariable  feedback 
system,  with  finite  dimensional,  linear  model  uncertainty.  He  derived 
a  sufficient  condition  for  stability  in  the  presence  of  model  uncertainty 
involving  (in  the  case  of  additive  model  error)  the  minimum  singular  value 
of  the  return  difference  transfer  function  matrix.  The  derivation  in¬ 
volved  a  relatively  simple  argument  based  on  the  multivariable  Nyquist 
theorem.  Mr.  Doyle  presented  several  interesting  examples,  and  demon¬ 
strated  various  graphical  means  of  evaluating  multivariable  feedback 
system  robustness. 

Prof.  N.R.  Sandell,  Jr.  considered  a  more  general  case  of  the  basic 
problem  considered  by  Mr.  Doyle  [2] .  The  nominal  feedback  system  was 
linear  but  possibly  infinite  dimensional  (so  that  time  delays,  for  example, 


-38- 


could  be  considered) ,  and  the  model  perturbations  were  allowed  to  be  nonlinear. 
A  sufficient  condition  was  obtained  involving  (for  an  additive  model  pertur¬ 
bation)  the  norm  of  the  inverse  return  difference  operator.  The  derivation 
was  based  on  standard  results  in  input-output,  stability  theory.  In  the 
linear  case,  the  condition  obtained  reduces  to  Doyle's  condition.  An  appli¬ 
cation  to  singular  perturbation  theory  was  briefly  mentioned. 

Prof.  M.G.  Safonov  consider  a  still  more  general  case  [3] ,  in  which  the 
feedback  system  consisted  of  a  set  of  interconnected  nonlinear  systems,  with 
model  uncertainty  entering  in  a  fairly  general  way.  The  analysis  was  based 
on  some  recent  extensions  of  classical  input-output  stability-theoretic 
results  [4] ,  and  the  conditions  derived  included  those  of  Doyle  and  Sandell 
when  appropriately  specialized. 

Prof.  C.A.  Dosoer  also  considered  a  rather  general  case  involving  non¬ 
linear  time-varying,  multivariable,  and  distributed  feedback  systems  [5], 

Prof.  Desoer  did  not  confine  himself  to  stabilization  as  the  previous 
speakers  largely  did,  but  also  considered  the  issues  of  desensitization,  dis¬ 
turbance  attenuation,  linearizing  effect,  and  asymptotic  tracking  and  dis¬ 
turbance  rejection.  His  results  basically  require  that  the  linearized  in¬ 
verse  return  difference  operator  should  be  small  for  the  nonlinear  feedback 
system  to  possess  advantages  relative  to  the  open-loop  system. 

Several  of  the  previous  speakers  had  discussed  the  notion  of  the  sin¬ 
gular  value  decomposition,  and  Prof.  B.C.  Moore  gave  a  very  interesting 
account  of  some  preliminary  results  concerning  the  application  of  this 
decomposition  to  the  on-line  turning  of  multivariable  proportional- 
integral  controllers  [6].  Prof.  Moor*'  explained  that  the  basic  ideas 
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of  singular  value  analysis  Have  long  been  known  in  the  statistics  litera¬ 
ture  where  the  terminology  principal  component  analysis  is  used  instead. 

Dr.  A.J.  Laub's  paper  [7]  was  concerned  with  the  basic  problem 
formulation  considered  by  "ir.  Doyle.  Dr.  Laub  pointed  out  that  the  use 
of  singular  values  is  associated  with  a  particular  matrix  norm  (the 
norm) .  Other  norms  can  be  equally  well  used,  and  there  is  a  very  sub¬ 
stantial  computational  advantage  associated  with  some  of  them  (the 
and  Loo  norms) . 

After  the  focus  on  characterizing  the  robustness  properties  of  multi- 
variable  feedback  systems  in  the  first  day,  attention  turned  in  the 
second  day  to  the  issue  of  designing  robust  systems. 

Prof.  I.  Horowitz  has  long  been  interested  in  the  synthesis  of 
feedback  systems  subject  to  model  uncertainty,  and  he  gave  a  presentation 
of  his  methods  [8] .  The  basic  objective  of  his  technique  is  to  achieve 
desired  forms  for  the  elements  of  the  transfer  function  matrices  between 
command  and  disturbance  inputs  and  response  outputs.  Tolerances  on  these 
elements  are  necessitated  by  the  presence  of  parameter  uncertainty. 

Dr.  I.  Postlethwaite  represented  Prof .  MacFarlane ' s  group  at 
Cambridge  University,  and  discussed  their  techniques  for  assessing  the 
robustness  properties  of  a  linear  multivariable  feedback  design  [9], 

[10] .  These  techniques  involve  computing  the  singular  values  (termed 
principal  gains)  of  certain  transfer  function  matrices,  as  well  as 
determinations  of  stability  with  respect  to  system  parameters.  The 
interested  reader  will  want  to  carefully  consider  the  discussion  in 
Section  2  of  [9]  in  light  of  the  examples  discussed  in  Section  2.1  of 
this  report  and  Section  3  of  [1] . 


Prof.  J.E.  Ackermann's  paper  [11]  was  also  concerned  with  stability 
under  parameter  uncertainty.  Prof.  Ackermann's  approach  is  a  generalization 
of  classical  parameter  plane  techniques.  The  procedure  was  illustrated 
with  an  interesting  example  developing  a  feedback  controller  for  a  crane. 

Prof.  M.  Athans  presented  an  overview  of  what  is  known  about  the 
robustness  properties  of  LQ  regulators  [12],  [13].  He  described  how  the 
motivation  for  the  results  obtained  by  himself  and  his  students  derived 
from  a  study  supporting  the  design  of  the  automatic  depth-keeping  controller 
for  the  TRIDENT  submarine. 

The  guaranteed  robustness  properties  of  LQ  regulators  are  not  valid 
for  LQG  designs  (i.e.,  with  state  estimate  rather  than  state  variable 
feedback).  However,  for  minimum  phase  systems,  these  properties  can  be 
asymptotically  recovered  in  a  procedure  described  by  Prof.  H.  Kwaakernaak 
[14] .  The  basic  idea  of  this  procedure  is  to  modify  the  feedback  gains 
to  account  for  the  fact  that  state  estimate  rather  than  state  variable 
feedback  is  used.  There  is  a  dual  approach  involving  adjustment  of 
Kalman  filter  gains  that  was  discussed  by  Mr.  Doyle  [15] . 

The  robustness  properties  of  LQ  regulators  can  in  certain  cases  be 
improved  upon  by  other  forms  of  state  feedback.  One  result  is  that 
100%  gain  reduction  margins  and  90°  phase  margins  can  be  obtained  for  an 
open  loop  stable  system  when  feedback  obtained  from  solving  a  Lyapunov  rather 
than  a  Riccati  equation  is  considered.  This  result  is  implicit  in  [12], 
and  was  discussed,  with  related  ideas,  by  Prof.  J.C.  Willems  [16]  and 
Dr.  A.  Harvey  [17] . 


The  final  topic  of  discussion  was  design  examples  to  illustrate  the 
conference  presentations  during  the  previous  days.  Dr.  G.  Stein  presented 
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an  example  involving  some  trial  controller  designs  for  the  longitudinal 
degrees  of  freedom  of  the  CH-47  helicopter,  with  model  uncertainty  due 
to  rotor  dynamics  and  rate  limiting  [18].  Messrs.  N.  Lehtomaki  and  S. 

Chan  described  control  lav.  development  for  a  five  terminal  DC  power 
distribution  network  with  various  sources  of  model  uncertainty  [19] . 

3.2  Research  Directions 

In  the  course  of  the  workshop,  and  particularly  during  the  round¬ 
table  discussion  at  its  conclusion,  numerous  suggestions  were  advanced 
concerning  directions  for  future  research.  In  this  section  we  will  try 
to  briefly  recapitulate  some  of  the  suggestions;  we  will  not  attempt  to 
identify  specific  suggestions  with  individuals. 

There  was  widespread  agreement  on  the  need  for  work  attempting  to 
apply  the  concepts  that  have  been  developed  to  some  specific  design 
examples.  This  work  is  necessary  to  evaluate  the  results  obtained  so  far 
and  to  compare  the  practical  utility  of  the  various  approaches  -  for 
example,  to  compare  the  results  obtained  by  computing  |  ( I+G— 1  ( j(0)  |  | 
using  the  various  matrix  norms.  In  addition,  working  out  some  detailed 
examples  is  the  best  way  to  communicate  the  new  approaches  to  designers. 
Finally,  contact  with  applications  usually  suggests  new  theoretical 
problems.  Indeed,  it  was  the  attempts  to  apply  LQG  theory,  notably  at 
MIT  and  Honeywell,  that  led  to  the  work  motivating  the  conference. 

In  the  area  of  robustness  analysis  for  multivariable  systems,  one 
of  the  basic  needs  is  for  more  refined  tests  and  measures  of  robustness. 
The  present  measures  lead  to  overly  conservative  results  in  many  in¬ 
stances,  since  they  characterize  model  error  simply  by  its  norm.  In 
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the  single-input,  single-output  case  this  is  equivalent  to  considering  only 
the  magnitude  and  not  the  phase  error.  It  was  pointed  out  that  a  generali¬ 
zation  of  the  magnitude -phase  representation  of  a  transfer  function  is  the 
singular  value  decomposition  of  a  transfer  function  matrix.  The  singular 
values  generalize  the  notion  of  gain  and  the  orthogonal  matrices  of  right 
and  left  singular  vectors  generalize  the  notion  of  phase.  Thus  it  may 
be  possible  to  use  the  singular  value  decomposition  to  develop  robustness 
tests  that  give  information  concerning  the  nature  of  the  perturbation 
that  the  system  is  most  sensitive  to. 

The  presentations  at  the  workshop  focused  on  the  case  of  continuous 
time  systems,  but  the  discrete-time  case  is  of  great  interest  due  to  the 
trend  toward  digital  implementation  of  sampled  data  controllers.  Several 
phenomena  occur  in  sampled  data  control  that  greatly  complicate  analysis. 
Most  notable  of  these  is  aliasing,  which  implies  that  transfer  functions 
need  be  considered  that  do  not  rolloff  at  high  frequencies  (in  the 
idealized  case  of  impulsive  sampling) .  Some  work  has  been  done  for  the 
case  of  LQG  sampled -data  controllers  [37]  ,  but  the  extension  of  the 
results  discussed  at  the  workshop  to  sampled-data  systems  represents  an 
open  area  of  research. 

Similarly,  the  case  of  nonlinear  multivariable  systems  needs  more 
investigation.  Some  of  the  basic  theoretical  results  [37],  [2  J  —  C  5  J 
are  valid  for  nonlinear  systems,  but  little  has  been  accomplished  in  the 
practical  exploitation  of  these  results.  By  analogy  with  the  single¬ 
input,  single-output  case,  it  might  be  conjectured  that  the  present 
results  are  excessively  conservative.  One  direction  to  mitigate  this 
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difficulty  would  be  to  combine  describing  function  and  multivariable 
robustness  analysis  techniques,  although  the  strict  stability  theoretic 
interpretation  of  the  results  would  be  lost. 

In  the  area  of  techniques  for  synthesis  of  robust  multivariable 

feedback  systems,  little  is  known  except  for  the  case  of  the  LQG  methodology, 

where  the  basic  facts  are  in  hand.  In  the  LQ  case,  the  robustness 

properties  stem  from  the  fundamental  inequality  of  Kalman  which  implies 

that  an  LQ  loop  transfer  matrix  (at  all  frequencies)  avoids  the  unit  ball1 

about  the  -  I  loop  transfer  matrix.  It  was  pointed  out  that  it  would 

be  desirable  to  have  a  more  flexible  property,  in  which  one  could  chose 

a  frequency  dependent  radius  for  the  ball  that  is  avoided.  At  present, 

this  can  be  done  in  a  somewhat  ad  hoc  way  by  appending  compensation  to 

the  plant's  inputs  and  outputs.  It  was  suggested  that  a  more  systematic 

approach  might  be  possible  utilizing  frequency  dependent  weighting 

2 

matrices  in  the  quadratic  cost  function. 

For  the  LQG  case,  two  dual  methods  for  recovering  the  LQ  robustness 
properties  were  described.  The  relation  between  these  techniques,  and 
more  generally  the  tradeoff  between  robustness  and  performance  implicit, 
needs  to  be  explored.  It  is  significant  both  techniques  require  a 
minimum  phase  condition.  It  is  unclear  what  can  be  accomplished  in 
the  absence  of  this  condiition. 

The  implications  of  the  results  discussed  at  the  workshop  for  other 

^In  an  appropriate  norm. 

2 

Note  that  the  usual  practice  of  appending  compensator  dynamics  to  the 
plant  amounts  to  using  frequency  dependent  weighting  matrices. 
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design  methodologies  are  less  obvious.  The  use  of  graphical  frequency 
domain  techniques  for  multivariable  feedback  system  design  has  been  most 
completely  developed  by  MacFarlano  and  his  colleagues,  and  incorporation 
of  the  robustness  tests  described  herein  into  their  software  would  be 
straightforward.^  However,  the  synthesis  problem  is  more  difficult  to 
attack.  The  relationship  between  the  singular  values  of  I  +  G(jO))  and 
any  compensation  imbedded  in  G(jai)  is  extremely  complicated  -  even  more 
so  than  for  the  eigenvalues  of  I  +  G  ( joj) .  The  basic  problem  is  that, 
unlike  the  eigenvalues,  the  singular  values  of  I  +  G(jO))  bear  no  parti¬ 
cular  relationship  to  those  of  G(jGJ).  This  is  a  particular  problem  in 
the  important  crossover  region  where  I  and  G(jo>)  are  of  comparable 
magnitude . 


MacFarlane  and  his  colleagues  have  already  consider  the  use  of 
singular  values,  termed  "principal  gains",  albeit  in  a  slightly 
different  context. 
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ROBUSTNESS  OF  MULTI  LOOP  LINEAR  FEEDBACK  SYSTEMS* 


J.  C.  Doyle 
Consul tant 

Honeywell  Systems  and  Research  Center 
Minneapolis,  Minnesota 


ABSTRACT 


This  paper  presents  a  new  approach  to  the  analysis  of  robustness  or 
sensitivity  of  multiloop  linear  feedback  systems.  The  properties  of 
the  return  difference  equation  are  examined  using  the  concepts  of 
singular  values,  singular  vectors  and  the  spectral  norm  of  a  matrix. 

A  number  of  new  tools  for  multiloop  systems  are  developed  which  are 
analogous  to  those  for  scalar  Nyquist  and  Bode  analysis,  providing  a 
generalization  of  the  scalar  frequency-domain  notions  such  as  stability 
margins  and  M-circles. 


*  This  work  was  performed  for  Honeywell  Systems  and  Research  Center, 
Minneapolis,  MN,  with  partial  support  from  the  Office  of  Naval 
Research  contract  N-00014-75-C-0144 

Mailing  Address:  M.S.  MN17-2367,  Honeywell  Systems  &  Research  Center, 
2600  Ridgway  Parkway,  Minneapolis,  MN.  55413 

Telephone  No:  {612)378-4254 


I.  INTRODUCTION 


A  critical  property  of  feedback  systems  is  their  robustness;  that 
is,  their  ability  to  maintain  performance  in  the  face  of  uncertainti 
In  particular,  it  is  important  that  a  closed-loop  system  remain 
stable  despite  differences  between  the  model  used  for  design  and  the 
actual  plant.  These  differences  result  from  variations  in 
modelled  parameters  as  well  as  plant  elements  which  are  either 
approximated,  aggregated,  or  ignored  in  the  design  model.  The 
robustness  requirements  of  a  linear  feedback  design  are  often 
specified  in  terms  of  desired  gain  and  phase  margins  and  band¬ 
width  limitations  associated  with  loops  broken  at  the  input  to 
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the  plant  actuators(  1 ; ,  2  ).  These  specifications  reflect  in 
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part  the  classical  notion  of  designing  controllers  which  are 
adequate  for  a  set  of  plants  constituting  a  frequency-domain 
envelope  of  transfer  functions  3*1  .  The  bandwidth  limitation 

.  J 

provides  insurance  against  the  uncertainty  which  grows  with 
frequency  due  to  unmodeled  or  aggregated  high  frequency  dynamics. 

The  Nyquist  or  Inverse  Nyquist  diagram  (polar  plots  of  the  loop 
transfer  function)  provides  a  means  of  assessing  stability  and 
robustness  at  a  glance.  For  multiloop  systems,  scalar  Nyquist 
diagrams  may  be  constructed  for  each  loop  individually  providing 
some  measure  of  robustness.  Unfortunately,  the  method  may  ignore 
variations  which  simultaneously  affect  multiple  loops. 


There  are  a  number  of  other  possible  ways  to  extend  the  classical 
frequency-domain  techniques.  One  involves  using  compensation  or 
feedback  to  decouple  (or  approximately  decouple)  a  multiloop  system 
into  a  set  of  scalar  systems  which  may  be  treated  with  scalar 
techniques  (i.e.,  "Diagonal  Dominance",  Rosenbock  [V  ).  Another 
method  uses  the  eigenvalues  of  the  loop  transfer  matrix  (G(s)  in 
Figure  1)  as  a  function  of  frequency  (i.e.,  "Characteristic  Loci", 
KacFarlane,  et.  al.  ^  5  !  ,  ).  While  these  methods  provide 

legitimate  tools  for  dealing  with  multivariable  systems,  they  can 
lead  to  highly  optimistic  conclusions  about  the  robustness  of 
multiloop  feedback  designs.  Examples  in  Section  III  will  demonstrate 
this. 

This  paper  develops  an  alternative  view  of  multiloop  feedback 
systems  which  exploits  the  concepts  of  singular  values,  singular 
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vectors,  and  the  spectral  norm  of  a  matrix.  (  7j  -  '10  ).  This 
approach  leads  to  a  reliable  method  for  analyzing  the  robustness 
of  multivariable  systems. 

Section  II  presents  a  basic  theorem  on  robustness  and  sensitivity 
properties  of  linear  multiloop  feedback  systems.  Multivariable 
generalizations  of  the  scalar  Nyquist,  Inverse  Nyquist  and  Bode 
analysis  methods  are  then  developed  from  this  same  result. 

Two  simple  examples  are  analyzed  in  Section  III  using  the  tools 
of  Section  II.  As  promised,  the  inadequacies  of  the  existing 
approaches  outlined  earlier  will  be  made  clear. 

Section  IV  contains  a  discussion  of  some  of  the  implications  of 
this  work. 


The  goal  of  this  paper  is  to  focus  on  the  analysis  of  robustness 
and  sensitivity  aspects  of  linear  multiloop  feedback  systems. 

Some  new  approaches  emerge  which  yield  important  insignts  into 
their  behavior.  The  mathematical  aspects  of  these  topics  are 
fairly  mundane  at  best,  so  rigor  and  generality  are  almost  always 
sacrificed  for  simplicity. 

Preliminaries  and  Definitions 


A  brief  discussion  of  singular  values  and  vectors  follows.  Although 
the  concepts  apply  more  generally,  only  square  matrices  will  be 
considered  in  this  paper.  A  more  thorough  discussion  of  these 
topics  may  be  found  in  ;  7  -  ’  10  . 

The  singular  values  o.  of  a  complex  n  x  n  matrix  A  are  the  non- 

1  *  * 
negative  square  roots  of  the  eigenvalues  of  A  A  where  A  is  the 

* 

conjugate  transpose  of  A.  Since  A  A  is  Hermitian,  its  eigenvalues 

i  it 

are  real.  The  (right)  eigenvectors  v.  of  A  A  and  r,.  of  AA  are 
the  right  and  left  singular  vectors,  respectively,  of  A.  These 
may  be  chosen  such  that 

°ir1  *  Av1  •  1*1.  ...  n 

(1) 

01  <  o2  <  ...  <  on 

and  the  {r^}  and  {v.}  form  orthonormal  sets  of  vectors. 


It  is  well  known  that 


where  R  and  V  consist  of  the  left  and  right  singular  vectors, 
respectively,  and  z  =  diag.  (clt  ...»  o^).  The  decomposition 
in  (2)  is  called  the  singular  value  decomposition. 

Denote 


o_  (A)  =  min  |  |Ax|  |  =  o, 
11*11*1 


(3) 


and 

o(A)-  M“f.  !  1 1  Ax  1 1  -  l|A|lz-on  (4) 

where  ||x||  =  (x*x)^  and  1 1  •  1 1 ^  is  the  spectral  norm. 


The  singular  values  are  important  in  that  they  characterize 
the  effect  that  A  has  as  a  mapping  on  the  magnitude  of  the 
vectors  x.  The  singular  values  also  give  a  measure  of  how 
"close"  A  is  to  being  singular  (in  a  parametric  sense).  In 
fact,  the  quantity 

£ 

o 

is  known  as  the  condition  number  with  respect  to  inversion  9  . 

The  eigenvalues  of  A  do  not  in  general  give  such  information. 

If  x  Is  an  eigenvalue  of  A,  then 

o  <  lx)  <  a 

and  it  is  possible  for  the  smallest  eigenvalue  to  be  much  larger 
than  o. 


II.  BASIC  RESULTS 


r 

Consider  identity  the  feedback  system  in  Fig.  2  where  G(s)  is  the  rational 
loop  transfer  matrix  and  L(s)  is  a  perturbation  matrix,  nominally  zero, 
which  represents  the  deviation  of  G(s)  from  the  true  plant.  While  this 
deviation  is  unknown,  there  is  usually  some  knowledge  as  to  its  size. 

A  reasonable  measure  of  robustness  for  a  feedback  system  is  the  magnitude 
of  the  otherwise  arbitrary  perturbation  which  may  be  tolerated  without 
instability.  The  following  theorem  characterizes  robustness  in  this  way. 

The  "magnitude"  of  L(s)  is  taken  to  be  the  spectral  norm.  Only  stable 
perturbations  are  considered  since  no  feedback  design  may  be  made  robust 
with  respect  to  arbitrary  unmodeled  unstable  poles. 

Robustness  theorem:  Consider  the  perturbed  system  in  Fig.  2  with  the  follow¬ 
ing  assumptions 

i)  G(s)  and  L(s)  are  nxn  rational  square  matrices, 

ii)  det  (G(s))  $  0 

iii)  L ( s )  is  stable 

iv)  the  nominal  closed  loop  system 
H  *  G(I+G)_1 
is  stable. 

Under  these  assumptions  the  perturbed  system  is  stable  if 

£  (I  ♦  G(s)  *)•  >  c  (L(s))  (5) 

for  all  s  in  the  classical  Nyquist  D-contour  (defined  below) 

Proof: 


It  is  well  known  4  that  since  G  is  invertible 


(6) 


-1  -1  ^j(s) 

det(H(s)  l)  =  det  (I  +  G(s)  l)  = 


where  ^  (s)  is  the  nominal  closed-loop  characteristic  polynomial  and  $  (s) 
is  the  transmission  zero  polynomial  of  G  JllJ  . 


For  the  perturbed  system 


det  (I  +  G(s;  +  L(s))  = 


*2(s) 

^(sH3(sT 


where  ^(s)  is  the  perturbed  closed-loop  characteristic  polynomial  and 
^(s)  is  the  characteristic  polynomial  of  L(s). 

Let  D  be  a  large  contour  in  the  s-plane  consisting  of  the  imaginary  axis  from  -jR  to 
+jR,  together  with  a  semicircle  of  radius  R  in  the  right  half-plane.  The 

radius  R  is  chosen  large  enough  so  that  all  finite  roots  of  ^(s)  have 

magnitude  less  than  R. 

Let  the  contour  rQ  be  the  image  of  D  under  the  map  i|y(s)  det  (I  +  G(s)~^. 

Since  H  is  stable,  it  follows  from  the  principle  of  the  argument  that  rQ 

will  not  encircle  the  origin. 

Define  the  map  ’ 

-r(q.s)  =  4>j ( s )  det  (I  +  G(s)'1  +  qL(s)),  q  real  (8) 


and  let  y(q,s)  map  D  into  the  Contour  r(q)  for  fixed  q,  o<q<l. 
y(q,s)  may  be  written  as 


y(q.s)  « 


^(sHjfs)  +  qe^s)  +  ...  +  qnen(s) 


*4(q.s) 


The  map 


Clearly,  since  r(o)  =  r  ,  it  does  not  encircle  the  origin.  Since  the  roots 
of  are  algebraic  functions  of  q,  they  are  continuous  in  o  J12J  .  Thus 
the  only  way  that  the  perturbed  contour  r(l)  can  encircle  the  origin  is  for 

det  (I  +  G(s)'1  +  qL(s) )  =  0  (10) 

for  some  s  in  D  and  some  q  on  the  interval  o^q^l.  (Recall  that  <j^(s)  has 

no  riqht  half-plane  roots).  When  (10)  is  satisfied  then  £  (1  +  G’*  +  qL) 
must  also  be  zero.  However,  as  a  consequence  of  (5) 

o  (I  +  G  ^  +  qL)  ££  (I  +  G  ^)  -  q  o(L) 

>o(I+  G'1)  -  o(L) 


Thus  r(q)  does  not  encircle  the  origin  for  o<g<l.  In  particular,  the 
perturbed  contour  r(l)  does  not  encircle  the  origin,  and  the  perturbed  closed- 
loop  system  is  stable,  ; 

Similar  theorems  hold  for  additive  rather  than  multiplicative  perturbations 
(with  I  +  G  substituted  for  I  +  G~*)  as  well  as  a  number  of  other  configurations. 

This  theorem  points  out  the  importance  of  singular  values.  In  particular, 
the  smallest  singular  value  o(I  +  G(juj)’*)  gives  a  reliable  frequency- 
dependent  measure  of  robustness.  Stability  is  guaranteed  for  all  perturbations 
whose  spectral  norm  is  less  than  £.  As  will  be  seen  in  the  examples,  eigen¬ 
values  do  not  give  a  similarly  reliable  measure. 

>> 

The  singular  values  also  have  useful  graphical  interpretations.  Consider 
the  dyadic  expansion 


I  +  G' 


In  of  v* 
1*1  1  1  1 


where  the  o-,  r.  and  v.  are  the  singular  values,  and  left  and  right  singular 

1  1  1  _  i 

vectors,  respectively  of  I  +  G  .  This  is  an  alternative  form  of  the  sing¬ 
ular  value  decomposition  in  equation  (2). 

It  has  been  shown  that  the  eigenvalues  and  eigenvectors  of  a  rational 
matrix  are  continuous  (through  generally  not  rational)  functions  of 
frequency.  Since  singular  values  and  vectors  are  just  special  cases, 
o^jui),  r.. (jw)  and  v..(jw)  are  also  continuous  functions  of  w. 

Since 

H  =  (I  +  G-1)'1  =  z  1  v  r  *  (13) 

°i  1  1 

the  values  l/oj(ju>)  and  l/o  (jo;)  give  the  maximum  and  minimum  possible 
magnitude  responses  to  an  input  sinusoid  at  frequency  w.  Eigenvalues  give 
no  such  information.  In  this  sense,  a  plot  of  these  singular  values  vs. 
frequency  may  be  thought  of  as  a  multivariable  generalization  of  the  Bode 
gain  plot.  Plots  of  this  type  will  be  referred  to  as  o-plots. 


Another  useful  graphical  interpretation  analogous  to  the  scalar  Inverse 
Nyquist  diagram  may  be  constructed  by  noting  that 


*  Eoiri,(  -  1 


■  l0irivf  -  £Vi 

■  •  vi>vi* 


E6iVi 


(14) 


where  -  v..  with  e..  real  and  ||g^||  *  1  for  all  1. 

(The  g/s  do  not  necessarily  form  an  orthonormal  set.) 


The  quantities  in  (14)  at  some  frequency  are  related  as  in  diagram  in 
Fig.  3a.  Since  is  of  unit  length  a  complex  plane  may  be  constructed  as 
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m 


—  . . 


in  Fig.  3b,  to  lie  in  the  plane  formed  by  the  triangle  of  v.,o^r^  and 

Define  z..  to  be  the  complex  number  at  the  point  of  the  triangle  as  in  Fig.  3c. 
Then,  by  rotating  the  complex  plane  with  the  triangle  as  a  function  of 
frequency,  a  z^ju)  may  be  obtained  which  is  a  continuous  function  of  u 
(Fig.  3d).  This  allows  the  important  quantities  in  (13)  and  (14),  that  is, 
the  o..  and  to  be  represented  in  convenient  graphical  form.  As  noted  in 
Fig.  3d,  there  is  an  ambiguity  to  z^  depending  on  which  side  the  plane  is  viewed. 
(To  be  more  precise,  the  z^  represent  a  multivalued  function  of  s  which  could 
be  defined  on  appropriate  Riemann  sheets.  However,  this  will  be  ignored.) 

The  z..  may  be  calculated  by  finding  the  roots  of  the  quadratic  equation 

z.2  4  (1  4  B2  -  c.2)z.  +  ei2  =  0  (15) 

By  plotting  the  z.(jw)  c..  =  l,...m)  for  frequencies  of  interest  a  plot 
analogous  to  the  scalar  Inverse  Nyquist  plot  is  generated.  While  phase 
does  not  have  the  conventional  meaning  on  these  plots,  the  more  important 
notion  of  distance  from  the  critical  point  preserves  its  importance. 

These  plots  will  be  referred  to  as  z-plots. 

Concepts  such  as  M-circles  are  also  obvious  in  this  context.  The  minimum 
value  of  M  is  given  by 

Km  *  7 

Similar  results  nay  bo  for  obtained  additive  perturbations  by  working  with 
I  4  G  rather  than  I  +  6”  .  In  this  case  a  diagram  is  generated  which  is 
analogous  to  the  scalar  Nyquist  diagram.  A  number  of  other  configurations 
may  be  handled  as  well. 


« 


Note  that  singular  values  offer  no  encirclement  condition  to  test  for 
right  half-plane  poles.  Another  test  must  be  made  for  absolute  stability 
but  this  presents  no  obstacle  as  many  simple  techniques  exist  for  doing 
this.  Once  stability  is  determined  the  various  approaches  presented  in 
this  Section  may  be  used  to  reliably  analyze  robustness. 
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III.  EXAMPLES 


Two  simple  examples  are  presented  and  analyzed  using  the  approaches 
developed  in  the  previous  section.  For  the  purpose  of  comparison, 
the  methods  of  loop-breaking,  direct  eigenvalue  analysis  of  G,  and 
diagonal ization  by  compensation  are  also  used.  The  advantage  of 
the  interpretation  of  robustness  given  in  this  paper  is  clearly 
illustrated. 

The  first  example  is  an  oscillator  with  open  loop  poles  at  +10j 
and  both  closed  loop  poles  at  -1.  There  are  no  transmission 
zeros.  The  loop  transfer  function  is 


fs-lOO  10(s+l) 

l 

G(s)  =  -J- - 

s^+100 

_-10(s+l)  S-100  - 


(16) 


By  closing  either  loop  (the  system  is  symmetric)  as  in  Figure  4, 
the  transfer  function  for  the  other  loop  is 

3(s)  *  \ 

which  indicates  «°  db  gain  margin  in  both  directions  and  90°  phase 
margin  in  each  loop  (with  the  other  closed).  This  is  very  misleading, 
however. 

The  z-plot  for  this  example  is  shown  in  Figure  5.  It  may  appear 
somewhat  peculiar,  since  it  is  not  a  plot  of  a  rational  function. 


The  important  feature  is  the  proximity  of  the  plot  to  the  critical 
point,  indicating  a  lack  of  robustness. 

The  apparent  discrepency  between  these  two  robustness  indications 
can  be  easily  understood  by  considering  a  diagonal  perturbation 

0 

(17) 


where  and  k2  are  constants. 

Then  regions  of  stability  and  instability  may  be  plotted  in  the 
(kp  k2)  plane  as  has  been  done  in  Figure  6.  The  open  loop  point 
corresponds  to  k1  =  k2  =  -1  and  nominal  closed  loop  point  corresponds 
to  kj  =  k2  =  0.  Breaking  each  loop  individually  examines  stability 
along  the  k^,  k2  axes  where  robustness  is  good,  but  misses  the  close 
unstable  regions  caused  by  simultaneous  changes  in  kj  and  k2-  Thus, 
single  loop  analysis  is  not  a  reliable  way  of  testing  robustness. 

The  second  example  is  a  two  dimensional  feedback  system  with  open- 
loop  poles  at  -1  and  -2  and  no  transmission  zeroes. 


The  loop  transfer  matrix  is 

r -47s  +  2 


6(s)  =  fs+DTs+ZT 


L-42s 


56s 


50s  +  2  J 


(18) 
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Assume  that  identity  feedback  is  used,  with  closed-loop  poles  at 
-2  and  >4.  This  system  may  be  diagonalized  by  introducing  constant 
compensation.  Let 

r~  ~~ 

7  8 


V  =  U 


Then  letting 


6  =  VGU 


-1  _ 


7  -8 


-D  / 


the  system  may  be  rearranged  so  that 

H  =  G(I  +  G)"1 
=  UGV ( I  +  UGV)"1 
=  UG( I  +  G)_1V 
=  U  [  G(I  +  G)  j  V. 

This  yields  a  diagonal  system  that  may  be  analyzed  by  scalar 
methods.  In  particular  under  the  assumption  of  identity  feedback 


G  represents  the  new  loop  transfer  matrix.  Because  U  and  V 
represent  a  similarity  transformation,  the  diagonal  elements  of 
G  are  also  the  eigenvalues  of  G  so  that  the  decoupling  or  dominance 
approach  and  eigenvalue  or  characteristic  loci  approach  would  gen¬ 
erate  the  same  Nyquist  or  Inverse  Nyquist  plot  shown  in  Figure  7. 
Only  a  single  locus  is  shown  since  the  contours  of  1/ (s  +  1)  and 
2/(s  +  2)  are  identical.  The  tempting  conclusion  that  might  be 
reached  from  these  plots  is  that  the  feedback  system  is  emminently 
robust  with  apparent  margins  of  ±  <=  db  in  gain  and  90°+  in  phase. 
The  closed-loop  pole  locations  would  seem  to  support  this. 

This  conclusion,  however,  would  be  wrong.  The  z-plot  for  I  +  G"1 
is  shown  in  Figure  8  and  there  is  clearly  a  serious  lack  of  robust¬ 
ness.  The  (kj,  k2)  -  plane  stability  plot  for  this  example  is 
shown  in  Figure  9.  Neither  the  diagonal  dominance  nor  eigenvalue 
approaches  indicate  the  close  proximity  of  an  unstable  region. 

This  failure  can  be  attributed  to  two  causes. 

First,  the  eigenvalues  of  a  matrix  do  not,  in  general,  give  a 
reliable  measure  of  its  distance  (in  a  parametric  sense)  from 
singularity,  and  so  computing  the  eigenvalues  of  G(s)  (or  I  +  G(s)) 
does  not  give  an  indication  of  robustness.  Using  eigenvalues 
rather  than  singular  values  will  always  detect  unstable  regions 
that  lie  along  the  kj  =  k2  diagonal,  but  may  miss  regions  such 
as  the  one  in  Figure  9. 

Second,  when  compensation  and/or  feedback  is  used  to  achieve 
dominance,  the  "new  plant"  includes  this  compensation  and  feed¬ 
back.  Because  of  this,  no  reliable  conclusions  may  be  drawn  from 
this  "new  plant"  concerning  the  robustness  of  the  final  design  with 
respect  to  variations  in  the  actual  plant.  It  is  important  to 


evaluate  robustness  where  there  is  uncertainty. 


Another  important  property  of  multiloop  feedback  is  that,  unlike 
scalar  feedback,  pole  locations  alone  are  not  reliable  indicators 
of  robustness.  This  was  demonstrated  in  the  last  example  and  may 
be  explained  as  follows.  Consider  a  state  feedback  problem  where 
the  plant  is  controllable  from  each  of  two  inputs.  One  input  may 
be  used  to  place  the  poles  far  into  the  right  half  plane  and  the 
other  used  to  bring  them  back  to  the  desired  location.  Such  a 
high-gain  control  design  of  "opposing"  loops  will  be  extremely 
sensitive  to  parameter  variations  regardless  of  the  nominal  pole 
locations. 

It  is  interesting  to  examine  the  o-plot  of  H  =  G(I  +  G)”*  for  the 
second  example  shown  in  Figure  10.  Recall  that  the  singular  values 
of  H  are  equal  to  the  inverses  of  the  singular  values  of  I  +  G~*. 
There  is  a  rather  large  peak  in  the  frequency  response  at  approxi¬ 
mately  3  radians.  This  could  not  occur  in  scalar  unity  feedback 
systems  without  there  being  a  pole  relatively  near  the  imaginary 
axis.  It  can  happen  in  multiloop  systems  because  of  the  high 
gains  possible  without  correspondingly  large  pole  movement. 


IV.  FURTHER  COMMENTSAND  CONCLUSIONS 

The  approach  to  the  analysis  of  robustness  presented  here  appears  to  yield 
useful  insight  into  the  properties  of  multiloop  feedback  systems  which  may 
provide  the  basis  for  a  multivariable  stability  specification  analogous  to 
gain  and  phase  margines  for  scalar  systems.  One  possible  difficulty  with 
the  approach  is  that  it  can  lead  to  overly  pessimistic  views  of  robustness 
because  it  considers  perturbations  which  may  not  be  physically  possible. 

This  problem  exists  as  well  with  gain  and  phase  margin  evaluations.  Of 
course,  some  of  this  difficulty  can  be  alleviated  by  examining  the  specific 
perturbations  leading  to  instability.  These  may  be  easily  computed  from 
equation  (  12  ).  On  the  other  hand,  it  might  be  argued  that  some  healthy 

pessimism  would  be  refreshing  in  the  field  of  multivariable  linear  control 
research. 

Although  for  simplicity's  sake  only  rational  transfer  functions  were  considered 
the  results  in  this  paper  should  extend  to  nonrational  transfer  functions.  In 
practical  application  it  should  be  possible  to  use  frequency  response  data 
directly. 

The  results  may  also  be  extended  to  include  nonlinear  perturbations  by  exploiting 
the  general  stability  theory  developed  by  Safonov  Jl^  .  In  this  setting, 
nonlinearities  may  be  loosely  viewed  as  linear  time-invariant  elements  with 
time-varying  parameters.  A  mathematically  more  rigorous  treatment  of  these 
issues  may  be  found  in  Zames(  jl4j  ,  Jl5j  ),  as  well  as  in  Jl3j 

The  results  in  this  paper  concerning  dominance  methods  and  use  of  characteristic 
loci  of  the  looo  transfer  matrix  are  not  meant  to  imply  that  design  procedures  employ¬ 
ing  these  methods  are  useless.  However,  simply  designing  "in  the  frequency 
domain"  is  no  guarantee  that  resulting  controllers  will  have  no  undesirable 
properties. 

Multivariable  diagrams  such  as  the  •  and  z-  plots  appear  to  be  amenable  to 
implementation  on  a  computer  with  graphic  and  plotting  capability.  Singular 
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values  and  vectors  are  particularly  easy  quantities  to  compute  [16J  .  This 
should  facilitate  their  active  use  in  multiloop  feedback  design  procedures 
The  question  naturally  arises  concerning  the  implications  of  the  singular 
value  approach  for  robust  synthesis.  Certainly,  this  appears  to  be  a 
promising  area  for  research. 
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ROBUST  STABILITY  OF  LINEAR  DYNAMIC  SYSTEMS  WITH 
APPLICATION  TO  SINGULAR  PERTURBATION  THEORY* 

by 

Nils  R.  Sandell,  Jr.  ** 

In  this  paper  we  will  give  a  simple  approach  to  determining  conditions 
for  stability  of  linear  feedback  systems  subject  to  additive  and  multipli¬ 
cative  perturbations  in  the  operators  describing  these  systems.  The  approach 
is  based  on  technic  .es  used  in  functional  analysis,  and  provides  an  alternative 
development  and  generalization  of  some  conditions  for  ‘'he  time  -  invariant 
case  that  have  appeared  in  the  literature  very  recent^.  .  As  an  example  of 
the  application  of  the  conditions,  we  consider  the  determination  of  finite 
regions  of  stability  for  singularly  perturbed  systems. 

1.  Introduction 

An  important  theme  in  system  theory  is  the  preservation  of  various 
system  theoretic  properties  in  the  face  of  variations  in  the  system  model. 
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It  is  possible  to  distinguish  two  variations  on  this  theme.  In  the  fi.rst, 
attention  is  restricted  to  infinitesimal  changes  in  the  parameters  of  the 
nominal  system  model.  Thus  one  begins  by  assuming  that  the  nominal  system 
has  a  certain  property,  and  then  asks  if  there  exists  an  open  set  about  the 
nominal  system  parameters  such  that  all  the  systems  with  parameters  in  this 
set  have  the  desired  property.  We  will  refer  to  investigations  of  this  first 
type  as  sensitivity  theory.  A  second  approach  requires  the  explicit  delineation 
of  finite  regions  of  models  about  the  nominal  model  for  which  the  given 
property  is  preserved.  We  will  refer  to  investigations  of  this  second  type 
as  robustness  theory. 

Within  the  context  of  sensitivity  or  robustness  theory,  there 
are  several  properties  that  have  been  investigated.  For  example,  it  is 
well  known  that  the  controllability  property  is  insensitive  to  small  para¬ 
meter  variations  [l,p.  43] .  As  another  example,  it  is  well  known  that 
type-1  servomechanisms  have  zero  steady  state  step  tracking  error  despite 
large  (but  not  destabilizing)  variations  in  their  transfer  function  matrices 
[2]  . 

In  this  paper  we  will  focus  on  the  robustness  of  the  stability 
property  of  linear  multivariable  feedback  systems.  This  subject  is  of  special 
interest,  since  stability  is  the  most  basic  system  theoretic  issue  and  since 
practical  feedback  systems  must  remain  stable  in  the  face  of  large  para¬ 
meter  variations. 

The  importance  of  obtaining  robustly  stable  feedback  control 
systems  has  long  been  recognized  by  designers  [3].  Indeed,  a  principal 
reason  for  using  feedback  rather  than  open-loop  control  is  the  presence  of 
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model  uncertainties.  Any  model  is  at  best  an  approximation  of  reality,  and 
the  relatively  low  order,  linear  time-invariant  models  most  often  used  for 
controller  synthesis  are  bound  to  be  rather  crude  approximations. 

In  classical  frequency  domain  techniques  for  single-input,  single-out¬ 
put  (SISO)  control  system  design,  the  robustness  issue  is  naturally  handled  [3] . 
These  techniques  employ  various  graphical  means  (e.g..  Bode,  Nyquist,  inverse- 

Nyquist,  Nichols  plots)  of  displaying  the  system  model  in  terms  of  its  frequency 
response.  From  these  plots,  one  can  determine  by  inspection  the  minimum  charge 
in  the  model  frequency  response  that  leads  to  instability.  These  changes  are 
often  quantified  by  the  gain  and  phase  margins  of  the  feedback  system;  sometimes 
the  design  is  required  to  have  certain  minima),  margins  in  order  to  be  acceptable 
[4,  p.  43]. 

In  modern  time  domain  techniques  (such  as  the  pole  placement  or 
linear-quadratic-Gaussian  approaches)  for  multiple-input,  multiple-output 
(MIMO)  systems,  the  robustness  issue  is  not  directly  dealt  with.  Instead,  it 
is  necessary  to  transform  the  resulting  design  to  the  frequency  domain  to  examine 
its  robustness  properties.  For  SISO  systems,  this  is  accomplished  as  for 
classical  designs,  but  the  situation  is  less  clear  in  the  MIMO  case,  where  it 
is  necessary  to  consider  simultaneous  variations  in  the  frequency  responses 
of  all  the  loops. 

Very  recently,  there  has  been  some  important  work  addressing  the 
multivariable  robustness  issue.  In  his  thesis  [5,6]  Safonov  gives  a  powerful 
approach,  based  on  a  multivariable  sector  stability  theorem,  that  can  characterize 
robustness  for  very  general  nonlinear  MIMO  feedback  systems.  In  a  recent  paper 
[7] ,  Doyle  develops  a  robustness  characterization  for  the  linear  time  invariant 
MIMO  case  (It  can  be  shown  that  Doyle's  result  can  also  be  obtained  by  Safonov's 


approach  [8].)  Doyle's  characterization  involves  computing  the  minimum  singular 
value  of  a  certain  transfer  function  matrix,  and  this  computation  essentially 
determines  the  minimum  simultaneous  variation  of  the  system  frequency  responses 
that  leads  to  instability.  Since  there  is  sophisticated  and  widely  accessible 
software  to  compute  singular  values  [9] ,  this  characterization  is  of  great 
practical  value. 

The  present  paper  is  prompted  by  two  observations.  First,  the  use 
of  singular  values  to  characterize  robustness  is  suggestive  of  connections  with 
numerical  analysis,  but  these  connections  are  not  clear  from  Doyle's  approach 
utilizing  the  multivariable  Nyquist  theorem.  Second,  a  specific  instance  of  the 
robustness  question  arises  when  a  system  is  approximated  by  making  a  singular 
perturbation  to  reduce  its  order.  A  related  motivation,  although  only  briefly 
discussed  in  this  paper,  arises  from  the  desire  to  use  multi-model  techniques  in 
the  design  of  decentralized  controllers  for  large  scale  systems  [10,11]. 

The  structure  of  this  paper  is  as  follows.  In  Section  2  we  consider 
the  robust  stability  of  MIMO  linear  feedback  systems  using  a  generalized  numerical- 

analytic  approach.  When  specialized  to  the  time  invariant  case,  with 
rational  transfer  function  matrix  perturbations,  Doyle's  characterization 

results.  In  Section  3  we  will  apply  the  results  of  Section  2  to  a  specific 
robustness  question  arising  in  singular  perturbation  theory.  Section  4  contains 
the  summary  and  conclusions. 

Notation 

We  will  use  the  standard  notation  of  input-output  stability  theory: 
see  [12,  pp.  13-14],  or  [13,  pp.  38-39]. 

X  =  some  Banach  space  of  functions  x:T  -*■  X 
T  *  subset  of  the  real  numbers 


X 


finite  dimensional  vector  space 


X  =  jx  s  P  x  e  X  for  all  tetI 
e  ‘  t  > 


(PTx) (t) 


x(t) 

0 


t  <_  T 

t  >  T 


=  space  of  m-vector  functions  on  T 
with  integrable  Euclidean  norm 

1  :  X^  -*■  =  identity  operator 

G  s  X  -*■  X  is  causal  if  P  GP  =  F  G 
e  e  forTiTT  T  T  T 

A*  =  conjugate  transpose  of  a  complex 
matrix  A. 


We  consider  the  feedback  system  depicted  in  Figure  1.  Here 

the  causal  linear  operator  G  :  gP  -*•  2>™e  represents  the  plant 

plus  any  compensation  that  is  used.  The  basic  feedback  equation 
is 

(I  +  G)e  =  u  (2.1) 

and  the  basic  stability  question  is  whether  (I  +  G) 

2e  x  2e 

exists,  is  causal,  and  is  a  bounded  linear  operator  when  restricted  to  the 
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subspace  of  •  We  assume  that  the  nominal  system  is  stable  in 

m 

this  sense  throughout  this  section,  i.e.  for  u  e  there  exists  a  unique 

causally  related  e  £  satisfying  (2.1),  and  that  u  implies  that  the 

corresponding  e  ciP™  and  consequently  y  =  u-e  ei^.  We  are  interested  in 
whether  the  closed  loop  system  retains  these  properties  when  subject  to 
additive  (Figure  2)  or  multiplicative  (Figure  3)  perturbations  representing 
uncertainty  in  the  dynamical  behavior  of  the  system. 

The  following  theorem  provides  the  basis  for  our  analysis. 


THEOREM  1 

Let  A:  X  -*■  X  be  a  causal  linear  ooerator,  and  suppose  A  1 
e  e 

exists,  is  causal,  and  is  bounded  when  restricted  to  X  .  Then,  if 

AA  :  X  -*•  X  is  a  causal  linear  operator  that  is  bounded  when  restricted 
e  e 

to  X  ,  and  if 

1 | A_1AAj  |  x  <  1,  (2.2) 

it  follows  that  (A  +  AA)_1  :  X  ■+  X  exists,  is  causal  and  is  bounded  when 

e  e 

restricted  to  X. 


Proof 


The  operator  A  ^AA  is  well  defined,  causal,  and  bounded  on  X 
by  assumption.  Since  j | A  ^AA! <  1,  the  contraction  mapping  theorem 
implies  that  the  sequence  x^,  k  =  0,1...,  defined  by 

Vi  ‘  ~A_1AAx^  +  b;  XQ  =  0  (2.3) 
converges  to  a  unique  solution  x£X  of 


83702AV>-067 


I+AG 


-lo¬ 


ci  +  A_1aA)x  *  b  (2.4) 

for  any  b  £  X.  Thus  (I  +  A  \lA)  1  :  X  *  X  exists,  and  is  therefore  bounded 
since  I  +  A  ^AA  is.  Causality  follows  since  each  iterate  x,^  depends  causally 
on  b  and  consequently  the  limit  x  of  x^_  depends  causally  on  b.  Since 
(I  +  A  1aA)  1  is  causal,  it  can  be  uniquely  extended  to  Xe  by  requiring 

P  (I  +  A"1AA)"1x  =  ?  (I  +  A'^A)"1?  x  (2.5) 

T  T  T 

for  x  e  Xe.  Finally,  defining 

(A  +  AA)"1  =  (I  +  A'^Al'V1,  (2.6) 

gives  the  required  inverse  of  A  +  AA.  Q.E.D. 

Remarks 

1.  Since 

UA'V||X  <  UA“1|lx  1|AA||X  (2.7) 

a  sufficient  condition  for  (2.1)  is 

I|AA||X<  l.  (2.8) 

2.  A  basic  result  in  numerical  analysis  is  that  if  an  nxm  matrix  A 
is  invertible,  then  A  +  AA  is  invertible  for  all  AA  satisfying 

O'  (AA)  <  o(A)  •  (2.9) 

where  a  (AA)  =  ||AA||2,  o(A)  =  ( |  |  A  1  ]  j  2 ) 

are  respectively  the  smallest  and  largest  singular  values  of  the  matrix  A. 
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Theorem  1  is  thus  a  generalization  of  this  classical  finite  dimensional  result  where, 
of  course,  boundedness  and  causality  are  not  at  issue.  In  the  finite  dimensional 
case  there  exists  AA  such  that  0  (AA)  =  a (A)  and  A  +  Aa  is  singular;  this  is 
easily  proved  by  the  singular  value  decomposition  . 

3.  The  contraction  mapping  argument  in  Theorem  1  is  a  standard  technique  of 
applied  mathematics ;  the  fact  that  X^is  not  a  Banach  space  complicates  the  argument. 
The  causality  argument  has  been  used  by  Willems  [12,  p.  98]  in  a  slightly 
different  context.  The  linearity  of  the  perturbation  operator  is  not  essential. 

4.  Theorem  1  can  be  used  to  give  S’  robust  stability  results,  but  we  will 

P 

confine  ouselves  to  the  case  p  =  2  in  the  sequel. 

5.  Theorem  1  can  be  used  to  obtain  robust  stability  results  for  both 
continuous  and  discrete  time,  but  in  the  sequel  we  will  confine  our  attention 
to  the  case  T  ■  [0,00]. 

The  robust  stability  questions  posed  at  the  beginning 
of  this  section  are  now  answered  in  terms  of  Theorem  2. 

THEOREM  2 

Assume  that  the  basic  feedback  system  of  Figure  1  is  stable.  Then 
( i)  the  system  remains  stable  for  additive  pertubations  G  (Figure  2)  provided 

||  (I +G)"lAG|  !^m  <  1  (2.10) 

and  (ii)  the  system  remains  stable  for  multiplicative  perturbations  AG  (Figure  3) 

^The  singular  value  decomposition  of  an  nxn  nonsingular  complex  matrix  A  is 

A=UlV* ,  where  U  and  V  are  unitary  nxn  matrices,  E  *  diag  (0.,  . ,a  )  and 

the  singular  values  a.  are  the  non-negative  square  roots  of  the  eigenvalues  cf 
A*A .  See  [14]  for  references,  a  more  general  definition,  and  an  excellent 
discussion  of  the  fundamental  role  of  the  singular  value  decomposition  in  linear 
systems  theory. 

I 
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provided 

|  i  [I  -  (I  +  G)~LJAG|  j^m  <  1  (2.11) 

Proof 

For  case  (i) ,  we  apply  Theorem  1  to  the  equation 

(I  +  G  +  AG) e  =  u  (2.12) 

while  for  case  ( i i )  we  consider 

[I+G(I+AG)]e  =  ( I +G+ ( I +G) AG-AG) e  =  u.  Q.E.D.  (2.13) 

The  practical  importance  of  Theorem  2  stems  from  the  fact  that  the 
norm  of  a  linear  convolution  operator  can  be  computed  from  its  transfer 
function  matrix.  This  fact,  which  is  a  consequence  of  Parseval's  Theorem, 
is  well  known  in  the  input-output  stability  theoretic  literature;  see, 
e.g.,  [13,  p.  26]. 
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and  where  O' .  £ G ( jeo ) )  denotes  the  ith  singular  value  of  the  transfer  function 
matrix  corresponding  to  G  . 

Combining  Theorem  2  and  Lemma  1/  we  obtain  the  following  result. 
THEOREM  3 

Assume  that  the  nominal  system  in  Figure  1  is  time  invariant,  stable, 
and  that  the  operators  ( I-t-G)  \AG  Can  be  represented  as  convolution 
operators  with  impulse  response  matrices  with  absolutely  integrable  elements. 
Then  (i)  the  system  remains  stable  for  additive  perturbations  AG  satisfying 

(AG(  jto) )  <  a(I+G(jo»),  cj  >  0  (2.17) 

and  (ii)  the  system  remains  stable  for  multiplicative  perturbations 
satisfying 

a(AG(jo>))<  a  (I+G_1(  jco)  )  ,  co  >  0.  (2.18) 

Here  G(jco)  and  AG(j^)  are  the  transfer  functions  of  G  and  A G,  and 
0*(A)  and  0(A)  denote  the  maximum  and  minimum  singular  values  of  A. 

Proof 

(i)  From  Lemma  l  and  (2.17)  we  have 

||AG||  <  ||(I+G)'1|r1  (2.19) 

so  that 

|  |  (HG)_1J  |  j  |AG|  j  <  1.  (2.20) 

(ii)  Note  that 

a(I+G_1(  jco) )  =  |a  ((I+G~1(ju)  i*1]  }_1 

-  |  o[(i+G(ju)>  -i  G(  jco)  1  I’1  =  a(I-(I+G(jai))  1]  (2.21) 

Therefore  Lemma  1  and  (2.18)  imply  that 

|  |  I  -  (J+G)~l\ |  | | AGj |  <  1.  (2.22) 

Q.E.D. 


Remarks 


( 


1.  Notice  the  analogy  between  Theorem  3  concerning  robust  stability  of 
linear  systems  and  the  classical  result  quoted  previously  concerning  robust 
inversion  of  matrices  (or  bounded  operators) . 


2.  Theorem  3  for  the  case  of  rational  transfer  function  matrices  is  the 
result  of  Doyle  alluded  to  previously.  Doyle's  proof  is  completely  different, 
however,  depending  on  the  multivariable  Nyquist  Theorem,  so  that  the  connections 
with  the  inversion  issue  are  only  implicit. 

3.  The  quantity  (I+G(  jw ) )  or£(I+G  ( joi) )  is  easily  computed  and  plotted 
as  a  function  of  w.  Doyle  has  made  great  use  of  this  technique  in  the  analysis 
of  multivariable  feedback  systems.  Such  a  plot  plays  much  the  same 

role  for  determining  MIMO  robustness  properties  as  the  more  classical  Bode, 
etc.  plots  in  SISO  design. 

4.  The  quantity  C_  ^  (l+G(jco))  is  the  generalization  of  the  classical  Bode 
SISO  sensitivity  function  of  changes  in  the  closed-loop  transfer  function  with 
respect  to  changes  in  the  open- loop  transfer  function  in  the  following  sense. 

Let  y^  denote  the  output  of  the  system  of  Figure  1  for  a  given  input  and 

y^  the  corresponding  output  of  the  system  of  Figure  2  for  the  same  input. 

Then  one  can  show 


y^jco)  -  y2(jco) 


( I+G  ( jou ) 


-1 


AG(jco)  (G(  joo)  +  AG(  jco) ) 


1y2  c  jou) 

(2.23) 


so  that 

||y1(j«)“  y2(3o))||<  |  j  »G(jw)  u+G(ja>)  +  AG(ju))’l|lx 

i  |  y 2 ( jou ) !  j  .  (2.24) 


Consequently,  the  percentage  change  in  the  closed-loop  transfer  function 
matrix  is  attenuated  from  the  percentage  change  in  the  open  loop  transfer 


! 

! 

! 


r 


■ 


& 


function  matrix  by  the  factor  O  ^(i  +  G(jaj)) 

5.  On  the  other  hand,  the  perturbations  defining  the  SISO  gain  and 
phase  margins  are  multiplicative  rather  than  additive,  so  that  0_(I  +  G  ^(jco)) 
is  more  appropriate  as  a  measure  of  the  tolerance  of  the  feedback  system 

to  model  uncertainty. 

6.  It  is  in  general  impossible  to  express  0(1  +  G_^(jG)))  in  terms  of 
£ ( I  +  G  ( j(i) )  1 

7.  Consider  the  feedback  system  in  Figure  1  with 


G(s) 


-G(sl  -  A)_1B 


where 


B’K 


0  =  A'K  +  KA  +  C’C  -  KBB'K 


(2.25) 

(2.26) 
(2.27) 


(We  assume  [A,B]  controllable  and  [A,C]  observable  so  that  a  unique  positive 
definite  solution  of  (2.27)  exists.)  The  well  known  equality  [15] 

[I  +  G(-Sl  -  A)“1B]'  [I  +  G(sl  -  A)_1B]  =  I  +  IC (-Sl-A)_1B]'  [C(sl  -  A)~1B), 

(2.28) 

which  follows  from  (2.27)  after  a  little  manipulation,  shows  that  the  system 
is  robust  to  additive  pertubations .  Safonov  and  Athans  [6]  have  shown  that 
the  system  of  Figure  3  with  G(s)  defined  by(2.25)is  stable  for  AG(jai)  satisfying 
a(AG(  jo>) )  £  1/2  for  all  oj£0; 

this  can  also  be  inferred  directly  using  the  inequality  [19] 


0(1  +  G~1(jO)) )  > 


0(1  +  G(jto)) 


-  1  +  0(1  +  G(  joi) ) 

together  with  (2.28)  and  Theorem  3. 


(2.29) 


1 1 


. 
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3 .  Application  to  Singular  Perturbation  Theory 

In  the  previous  section  we  have  discussed  the  robustness  of  the  stability 
property  of  a  linear  dynamic  system  to  model  variations.  In  this  section  we 
will  consider  a  particular  form  of  model  variation  due  to  a  singular  perturbation.' 
We  consider  systems  of  the  form 


X  <t)  =  A11x1(t)  +  Ai2X2(t) 


£X2(t)  =  A21Xl(t)  +  A22X2(t) 


where  e>0  is  a  small  parameter,  and  it  is  assume  that  the  matrix  A  ^  is 
stable  (has  eigenvalues  with  negative  real  parts) .  We  define  the  so  called 
degenerate  system 


ha10 


‘\l  ~  *12*22  *21^  Xld  ^ 


associated  with  (3.1).  This  system  is  a  reduced  order  system  that  neglects 
certain  high-frequency  or  parasitic  effects  incorporated  in  the  model  (3.1). 

It  has  been  shown  that  the  stability  of  (3.2)  (in  the  sense  that  the  eigen¬ 
values  of  the  system  matrix  have  negative  real  parts)  is  insensitive  to  these 

effects  in  the  sense  that  there  exists  e  >0  such  that  (3.1)  is  stable  for 

o 

all  0<e<£Q  if  (3.2)  is  [17].  We  propose  to  examine  the  robustness  of  the 
stability  (in  the  input-output  sense  of  Section  2)  of  (3.2)  to  the  parasitic 
effects  present  in  (3.1) . 

We  begin  by  Laplace  -  transforming  equations  (3.1)  (assuming  zero  initial 
condition) . 


See  [16]  for  an  excellent  survey  of  results  in  singular  perturbation  theory, 


13.3) 


x^s)  =  (si  -  A11>  1  A1?x0(5) 

x2(s)  =  (esi  -  a22>  1  A  x^s) 

=  [I  -  estesl  -  A^)'1]  (-A~  2A21)  Xx  <s)  (3.4) 


To  apply  the  input-output  stability  results  of  the  previous  section  it  is 
necessary  to  apply  a  test  input  to  the  system.  This  is  most  conveniently 
done  as  illustrated  in  Figure  4,  although  other  locations  are  possible1. 

Figure  4  closely  resembles  Figure  3  with 

Gls)  =  A"1  A21(sI  "  A11)~1  a12  <3.5) 

AG(s,e)  =  -es(esl  -  A^)  1  (3.6) 

except  that  the  perturbation  is  post-multiplicative  rather  than  pre- 
multiplicative .  However,  assuming  G(s)  has  full  rank  as  a  rational  matrix, 
it  is  easily  verified  tnat  the  analysis  of  the  preceding  section  is  essentially 
unaffected.  Thus  we  have  the  following  result. 


To  insure  the  equivalence  of  the  input-output  stability  analysis  with  the 
condition  that  the  system  matrix  of  (3.1)  has  eigenvalues  with  negative  real 
parts,  it  is  necessary  to  have  the  conditions 


observable . 
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THEOREM  4 

Assume  that  the  system  of  Figure  4  is  stable  for  £  =  0.  Then  it  remains 
stable  for  all  £  >  0  satisfying  the  inequality 


o  (AG(  jw,e) ) 


a  (i  + 


g  1(  jcu) ) 


for  all  0)>0. 


(3.7) 


The  use  of  Theorem  4  is  illustrated  by  the  following  examples. 


Example  1 

x^(t)  =  x^t)  +  2  x2(t) 

ex2(t)  =  -x2(t)  -  x^(t) 


G(s) 


2 

s-1 


Ag(s,£) 


es 

es+1 


(3.8) 


(3.9) 

(3.10) 


In  this  case  for  which  G  and  AG  are  scalars,  the  condition  (3.7)  is 
equivalent  to 

| 1  +  G_1(ja»  |  >  | G( ju,e; |  (3.11) 

or 

1 1  +  G(  ju)  1  >  i  G(  jw)AG(  jco,e)  i  (3.12) 

for  all  ai>0 . 

The  condition  (3.12)  has  an  interesting  graphical  interpretation. 
Specifically  the  Nyquist  locus  of  G ( jco)  must  avoid  the  critical  point  -1 
by  at  least  the  distance  [  G(  jcu) AG(  jco)  j  (Figure  5).  It  is  easily  verified 
that  for  £  *+l  and  oj  =  /2,  we  have  |  1  +  G(  jw) !  *  |  G(  jai)AG(jO))  |  so  that 

*  1*  It  can  be  directly  verified  that  the  system  (3.8)  becomes  unstable 
for  £  *  1. 


Example  2 


G  ( s ) 


1 

s+1 


AG(s,e) 


£  S 
1+£S 


As  in  the  previous  example,  we  will  check  (3.12).  We  have 
v — ~  £W 

/2-kd2  >  2  >  1  >  r-  ■ :rm2 

—  —  i/l+  £  (o 

so  that  the  system  is  stable  for  all  £  >_  01 


(3.13) 


(3.14) 

(3.15) 


(3.16) 


Summary  and  Conclusions 


In  this  paper  we  have  considered  the  robustness  of  the  stability 
property  of  a  linear  feedback  system  to  variations  in  the  system  model. 

The  approach  was  to  generalize  a  fundamental  result  in  numerical  linear 
algebra  concerning  robust  inversion  of  matrices  to  linear  operators  of 
the  type  arising  in  input-output  stability  theory.  In  the  time-invariant 
case,  this  approach  specializes  to  give  sufficient  conditions  for  stability 
under  additive  and  multiplicative  perturbations  that  are  easily  verified 
by  computing  the  singular  values  of  certain  transfer  function  matrices. 

We  then  applied  the  robustness  condition  to  the  analysis  of  singularly 
perturbed  systems.  We  were  able  to  give  an  explicit,  readily  computable 
bound  on  the  magnitude  of  the  perturbation  parameter  £  that  can  be  tolerated 
and  still  have  a  stability  analysis  of  the  reduced  system  valid  for  the  full 
system. 

The  results  of  this  paper  are  felt  to  be  of  interest  for  two  reasons. 
First,  as  Doyle  has  previously  pointed  out  in  the  time  invariant  case  [7], 
the  characterization  and  design  of  robustly  stable  MIMO  feedback  systems 
is  a  fundamental  problem  in  control  theory  that  has  yet  to  be  completely 
resolved.  Second,  as  has  been  previously  emphasized  by  Zames  [IS]  and  Safonov 
[5] ,  a  fundamental  problem  in  large  scale  system  theory  is  to  give  conditions 
for  the  success  of  designs  based  on  multiple,  aggregate  models  of  a  single 
large  system  -  this  is  essentially  a  robustness  problem. 
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A  MULTILOOP  GENERALIZATION  OF  THE  CIRCLE  STABILITY  CRITERION  * 


Michael  G,  Safonov*1  *  and  Michael  Athans**  * 


Abstract 

A  frequency-domain  stability  criterion  is  pre¬ 
sented,  generalizing  the  well-known  circle  sta¬ 
bility  criterion  to  multiloop  feedback  systems 
having  bounded  nonlinearity,  parameter  varia¬ 
tions,  and/or  frequency-dependent  ignorance  of 
component  dynamics.  Unlike  previous  general¬ 
izations.  the  theory  is  not  restricted  to  weakly- 
coupled,  diagonally  dominant  or  nearly  normal 
systems.  Potential  applications  include  the 
analysis  of  feedback  system  integrity  and  multi¬ 
loop  feedback  system  stability  margins. 

1.  Introduction 


and  Zame3’  conic -relation  and  positivity  stability 
theorems  [2}  have  led  to  useful  characterizations 
of  sets  of  robustly  stable  feedback  laws  for  only 
a  limited  class  of  problems,  viz.  interconnec¬ 
tions  of  dissipative  systems  [3],  weakly  coupled 
interconnections  of  systems  [4]  (including  so- 
called  "diagonally  dominant"  systems  [5]  -  [7]) 
and  "nearly  normal"  systems  [8]  (which  can  be 
viewed  as  vector-space  isomorphisms  of  weakly 
coupled  systems).  It  has  been  argued  convinc¬ 
ingly  by  Rosenbrock  and  Cook  [9]  that  an  es¬ 
pecially  useful  feedback  design  tool  would  be  a 
more  general  multiloop  frequency-domain  sta¬ 
bility  criterion  that  includes  diagonal  dominance 
and  normality  results  as  special  cases. 


A  key  step  in  the  synthesis  of  robustly  stable 
feedback  systems  is  the  characterization  of  a 
set  of  feedback  laws  that  are  stabilizing  for 
every  element  of  the  set  of  possible  plant  dy¬ 
namics.  This  type  of  information  is  precisely 
what  is  provided  for  single-loop  feedback  sys¬ 
tems  by  such  input-output  stability  criteria  as 
the  Nyquist,  Popov,  and  circle  theorems.  In¬ 
deed,  the  practical  merit  of  classical  feedback 
design  procedures  involving  Nyquist  loci.  Bode 
plots,  and  Nichols  charts  is  in  a  large  measure 
directly  attributable  to  the  fact  that  these  design 
procedures  provide  the  designer  with  an  easily 
in*erpretable  charcterization  of  such  sets  of 
robustly  stable  feedback  laws.  Available  multi- 
variable  input-output  stability  criteria  such  as 
Rosenbrock's  multivariable  Nyquist  theorem  fl] 
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grant  NSG-1312,  by  Joint  Services  Elec¬ 
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monitored  by  AFOSR,  and  by  NSF  grant 
ENG73-05628. 
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ern  California,  Lo3  Angeles,  CA  93307. 
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The  main  result  of  the  present  paper  is  a 
stability  result  that  may  serve  this  purpose: 
Theorem  1  is  a  multiloop  generalization  of  the 
circle  stability  criterion  which  does  not  re¬ 
quire  diagonal -dominanc  e,  weak-coupling.  norm¬ 
ality,  or  near  normality.  The  result  allows  the 
frequency -domain  testing  of  the  stability  of 
muitiloop  feedback  systems  with  time-varying 
nonlinearities,  unknown-but  -  bounded  parameter 
variations,  and  even  singular  perturbations. 

T  T 

The  following  notation  is  used:  A  and  x 
denote  respectively  the  tjranspo|e  of  the  matrix 
A  and  the  vector  x  ;  A  and  x  duote  the 
complex  conjugate  of  the  matrix  A  1  and  the 
vector  xl  respectively;  the  determinant  of  a 
matrix  A  is  denoted  det(AL  the  Euclidian  norm 
of  a  vector  x  is  ,|  X  s-^x  x  ;  R^  denotes 
nonnegative  real  numbers;  the  functional  norm 
■  x  jT  and  inner  product  <<p  x,  >-  are  defined 
for  functions  X:  ■*  Rn  as 


where  for  any  x.  and  x-, 

i  “  r-  T 

<X,.  X2  >T  =  J3  X,  (t)  X,  (t)  dt. 

The  space  L2e  (R  ,  Rn  )  is  defined  as 

L2e  (R_  .  Rn  i  =  ix  :  R_  ■*Rn|  «x  ■  <* 

for  each  *tR  >  . 


1 


Given  any  matrix  A,  the  square-roots  of  the 
eigenvalues  of  A  -  A  are  called  the  singular  values 
of  A  [10.  pp.  5-11].  For  any  non-zero  Matrix  A.  we 
use  the  notation  amajJ(A)to  denote  the  largest  sing¬ 
ular  value  of  A  and  to  denote  the  smallest 

singular  value  of  A;  singular  values  are  always  non¬ 
negative  real  numbers  since  A**  A  is  always  posi¬ 
tive  semidefinite.  For  hermitian  A  (i.  e.  ,  A  -  A*), 
the  notation  anc*  \nix^) to  c*enote  respec¬ 
tively  the  greatest  and  least  eigenvalues  of  A  - 

hermitian  matrices  have  only  real  eigenvalues, 
so  ordering  of  eigenvalues  is  always  possible  via 
the  usual  ordering  of  real  numbers. 

An  °Pera<,or  is  a  mapping  of  functions  into 
functions;  for  example,  a  dynamical  system  map¬ 
ping  inputs  x  c  (R+,  R  )  into  outputs  y  €  L^e 
(R+,  R1^'  defines  an  operator.  All  operators  con¬ 
sidered  in  this  paper  are  Implicitly  assumed  to  be 
mips-inga  of  L2e  (R+,  Rnl )  into  L,e  (R+.  Rn2) 
for  some  positive  integers  nj  an<f  n->  ,  an  opera¬ 
tor  His  said  to  be  nonantic ipatjve  if 

(  H  xt)  (to)  =  (  H  x2  )  (tQ) 

for  any  tQ  and  any  pair  of  functions  x;  and  x, 
having  the  property  that  for  ail  t  <  t  . 

(  t  )  =  x2  (  t  )  ; 

i.  e.,  a  non  a.aticipative  operator  H  is  one  having 
the  property  that  its  instantaneous  output  Hx  at 
any  time  t  is  independent  of  the  values  assumed 
by  the  input  x(t)  at  future  times  t  >  t  .  We 
say  that  an  operator  H  mapping  signals 
x  5  L2e  (R^,  R"  )  into  signals  H  x  t  L,f  (R  ,  R™) 
is  I-2e  "  s*able  if  there  exists  a  constant  kT<  50 
such  that  for  all  x  6  L2g  (R  .  Rn)  and  T  =  R+ 

,i  h  x s  fc  ||  x  iiT  . 

II.  Problem  Formulation 


Our  results  concern  the  input-output  stability 
of  systems  consisting  of  a  dynamical  LTI  nega¬ 
tive-feedback  interconnection  of  m  memoryless 
time-varying  nonlinear  components  and  n  dyn¬ 
amical  LTI  components.  The  system's  equa¬ 
tions  thus  take  the  following  form  (see  Fig.  1): 


Memoryless  nonlinear  components 


y,  (t)  =  h j  (x(  (t)  .  t  ) 

y't)  =  h  lx  (t)  .  t  ) 
m  mm 

Dynamica l  LTI  co mpo neats 


Y  ,la)  =  H  ,  (s>  X  (s) 
mi- 1  •  m- 1  mm1 


Y  (s)  -  H  (si  X  (s)  > 

mfn  mpn  mm _ 

A  iorm  ot  global  input-output  stability,  our 


defmition  of  L;e  -  stable  is  equivalent  to 
'  L  stable  '  [11)  and  to'finite  gain  stable' 
(with  respect  to  the  L,  normi  [12j  when  H 
is  a  nonanticipative  operator. 


The  Svstem 


The  indogenous  variables  y^(t)  and  x^(t)  are 
the  system  'outputs'  and  the  exogenous  variables 
u^(t)  and  w(tl  are  the  system  'inputs'.  Each  of 

the  ’components'  (hj(-  ) . hm,  Hm+l>  .... 

Hm+n>  may  itself  be  a  Mi.MO  system  in  general, 
though  our  results  seem  to  be  most  easily  used 
and  interpreted  when  the  components  are  SISO. 


Our  stability  results  do  not  require  that  we 
have  available  an  exact  mathematical  description 
of  the  components.  For  each  of  the  nonlinear 
nondynamical  elements,  we  assume  only  that 
matrices  C.  ,  R.  ,  and  S.  can  be  found  such  that 
Rj  R  and  ^^S^are  positive  definite  and  suchthat 
si(hi(xi<t>-  b  -  CjX.(ti)/  s  iRjXjIt!  ,i  -  » ;’(x.(t)  i 
for  some  *  >  0,  all  x.(t),  and  all  t  ; 


For  each  of  the 
Hj(sl  (  i  ■  mil. 


(2.  31 

dynamical  LTI  components 
.  ,  m-n)  we  assume  only 


2 


thar  Hj(s)  has  a  proper  rational  transfer  function 
matrix  and  that  proper  rational  transfer  function 
matrices  C^(s),  R^(s|,  and  Sj(s)  can  be  found  such 
that  (-j'i)  R^(jsi )  and  S^lja  )  S^(ju)  are  positive 
definite  and  have  no  poles  on  the  3  =  j ju  axis  and 
such  that  H-(s)  -  C.(s)  has  no  pole3  in{  s  |  Re(s)20} 
and  1 


i  )  X.(jjb  )  -  C.(j*)X.U4)))i!2 

s  ;  R^(j  ji)  X.(ju) )  :|Z-  ,  ,|x.(jju)!|2 

for  some  «  >  0  ,  all  X^(j  ju)  and  all  si 


(2.6) 


(i  =  m+1 . m+n). 


For  notational  convenience,  we  define  the  follow¬ 
ing  block-diagonal  matrices 


C(a)  s  diag^Cj, 

- C  .  C  ,( s ) , .  . 

..C  (s)\ 

m  m+ 1 

m+n  / 

(2.7) 

R(s)  =  diag^Rj, . 

- Rm.  Rm+l,S)"' 

••’Rm+H 

(2.8) 

S'  S)  T  diag^S  ^ ,  . 

...  S  .  S  (5)... 

m  mfl 

..S  (s)) 

m+n  / 

(2.9) 

Comments: 


The  conditions  (2.  5)  -  (2.  6)  can  be  interpre¬ 
ted  as  saying  that  we  are  assuming  knowledge 
about  each  of  the  components  is  limited  to  an  ap¬ 
proximate  LTI  mode!  (via.  C.)  and  bounds  (de¬ 
termined  by  (Rj,  SJ)  on  the  coarseness  of  the 
approximation. 


For  the  case  of  S1SO  components,  the  condi¬ 
tions  (2.5)  and  (2.6)  can  be  replaced  respectively 
by  the  simpler  conditions 


(2.5') 


for  some  «  >  0  ,  all  x,(t)  4*  0,  and  all  t 
!  H.(jJU )  -  c.<j*)|2£|r.(j.i))(2  -  . 

for  some  «  >0  and  all  -tfi 


(2.  6') 


where  for  all  i  =  1, 


t; 

i 

r. 

i 


C. 

i 


R  S. 

i  i 


-1 


n+m 


(2.  10) 
(2.  11) 


These  5ISO  conditions  are  readily  interpreted 
graphically  as  shown  in  Fig.  2. 


- H.US! 

(b)  Nyquist  locus  of  LTI  component 
satisfying  (2.  6') 

U fc-j—  .  S[SO  Components _ 

III.  Main  Result 

Our  main  result  is  now  stated. 

Theorem  1  (Multiloop  Circle  Stability 
Criterion): 

Suppose  that  the  system  (2.  l)-(2.  4)  is 
L2e-*f*ble  for  the  case  when 

hj(x  t,  a  CjX  (i  =  1 . 1 

(3.1) 

ms)  ®  CT(s)  (i=m+l .  mm).  J 

Then,  a  sufficient  condition  for  the  system 
(2.1)  -  (2.4)  to  be  L2e  -stable  for  every  col¬ 
lection  of  h.(  •  .  t)  (i  =  1, . .  ,m)  and  H:(s) 

(i  =  m+1 , . . . ,  n)  satisfying  (2.  5)  and  (2.6) 
respectively  is  that  any  one  of  the  following 
conditions  hold  for  all  real  w 

0  Xmin((l+Cfjii)G+jn)jr  ^ (-jx  )  S(jWl+C(jJi  )G(jii)) 

-GT(-jii)RT(-ji,  iR(ji)  G(jJJ))  *  0 

'  (3.  fa) 

“>  Snuftci-j*  )+G'\-j+  sT-j+  )S(j+  l(c(jt)xG-1(jxj 
-RT  (-jai  i  R(ji  lj  i  0 

(3.  2bl 


I U MBM  i 


Ill)  a 


in  (S^“  '  (  C(**'  *  +  G  1^*‘  0  R  1(jJU  *)  = 

(■^(aij‘1  G(jUl)(l  +  CtjJolGO^sV)) 


a 

<3.2c) 
S  1 

(3.  2d> 


c  +  -  >1  r 

1  G(jO  1 


(4.2) 


where 


ri  =  ris;‘ 


=  ci 


Condition  (3.  2a)  is  imolied  by  (3.  2b)-(3.  2d)  and, 
when  the  inverses  G*^,  R'^,  S”^  are  defined, 
conditions  (3,  2a)-(3.  2d)  are  equivalent. 


or.  equivalently  (assuming  c^  >  0), 


PROOF:  See  Aopendix 
IV.  Discussion 

There  are  essentially  two  main  conditions 
which  must  be  satisfied  to  conclude  stability  from 
Theorem  Is  (i)  The  system  must  be  stable  when 
the  uncertain  nonlinear  components  h^(.,t)  and 
LTI  components  H.(s)  are  all  replaced  by  the  re¬ 
spective  LTI  approximations  C.  and  C^(s);  and, 
(iil  the  frequency-domain  condition  (3.  2)  must  be 
satisfied.  The  former  condition  can  be  verified 
a  variety  of  ways:  for  example,  one  may  check 
that  the  roofs  of  the  characteristic  equation 

det  (i  +  C(s)  G(s) )  =  0  (4.  1) 

'  2 

all  nave  negative  real  parts  ;  alternatively,  one 
may  apply  the  multivariable  Nyouist  criterion, 
checking  that  the  polar  plot  of  the  locus  of 
det  (C ( j  a  )  G(jr>)  encircles  the  point  -1  +  jO 
exactly  once  counterclockwise  for  each  unstable 
oper.-Ioop  poleofC(s)  G(s)  (multiplicities  counted) 
[1]  ,  [21].  The  latter  condition  (3.2)  requires 

that  one  plot  the  variable  a  (•  )  or  <r  (.  ) 

...  ,  min  max 

verses  a  and  verify  that  the  appropriate  inequal¬ 
ity  holds  for  all  jt  . 

In  the  special  case  in  which  there  is  a  single 
scalar  nonlinearity  hj(Xj.t)  (so  that  m  =  l  and 
n  =  0),  both  of  the  conditions  of  Theorem  i  can  be 
verified  by  inspection  of  the  polar  plot  of  G(ju) 
vs  »  .  Stability  for  the  special  case  h|(x^.t)  =  CjXj 
Is  assured  by  the  Nyquist  stability  criterion  if 
and  only  if  G|jv)  encircles  -l  +  jO  once  for  each 
unstable  pole  of  G(s)  as  u  increases  from  -  ”  to 
-  x  .  Condition  (3.  2)  becomes 


I  G(j-ii)  +  — 2 - J  1  > 

2  C 1  '  ri 

ii)  if  c  j  -  r  i  <0 


1 


iii)  if  c 


G(jJJ)  +  ~2 - J  1  < 

i 

2 


c>  •;» 


2  2 
C1  •  ri 


2  2 

rl  *  C1 


1 


=  0 


Re 


(g(jk  )  ) 


-1 


(4.3a) 


(4.  3b) 


(4. 3c) 


C1  + 


1 


These  conditions  on  G(  j  a* )  are  precisely  the  con¬ 
ditions  of  the  well-known  circle  stability  cri¬ 
terion  (cf.  [15]  ).  It  is  this  which  motivates  us  to 
refer  to  Theorem  1  as  a  'multiloop  circle  stability 

criterion'  - despite  the  fact  that  in  general  no 

circles  are  employed  in  verifying  its  conditions. 

One  car.  interpret  the  uncertainty  bounds 
(R.,  S.)  as  specifications  for  the  gain  margins 
anti  pliase  margins  cf  the  system  (2.  1 )-(?..  4). 

If  m  =  0,  if  Hj(s)  sC^s)  (i-t . n)  and  if  the 

components  are  5ISO,  then  under  the  conditions 
of  Theorem  1,  the  system  will  remain  stable 
despite  variations  in  the  individual  component 
gains  of  magnitudes  as  great  as  |r^(ji^  f  ~ 

(R;  (;  i)/Sj  (j c.)  I,  even  when  the  variations  occur 
simultaneously  in  ail  components.  So,  for  ex¬ 
ample,  the  system  can  tolerate  simultaneous 
gain  variations  or  phase  variations  of  at  leas^ 


Mi 


4  inf 

ID 


2C  log 


rjUW) 

Cjfi") 


db  (4. 4) 


if  C ( s )  G(s)  has  any  'decoupling  zeroe  > '  (i.  e.  ,~ 
uncontrollable  or  unobservable  poles),  then 
these  will  not  be  roots  of  (4.  1)  and  one  must 
check  separately  that  thrse  poles  have  negative 
real  parts  -  cf.  [14] 


M. 


=  inf  arcsln 

•I) 


r.ijud 

C.(j 


(4.5) 


- 


n  n  i  ■MiaiiilrfitT  i'll  i  '  ‘imi  _ LJ 


in  each  of  the  respective  component  input  chan¬ 
nel's  (i=l . n);  i.  e.  ,  the  system  has  gain  mar¬ 
gins  of  at  least  and  phase  margins  of  at 

least  at  the  inputs  to  the  respective  com¬ 

ponents  Ct(s)  (i=l,...  .n).  The  quantity 

k  =  a.  (stj  JI)  (c(j  Si)  +  G  \j  <»))  p.  \j  *)) 
m  min  y  V  /  /(4 .  6) 

is  the  amount  by  which  the  uncertainty  bounding 
matrices  Rj  can  be  simultaneously  increased 
without  violating  the  stability  conditions  of  The¬ 
orem  i  - the  scalar  km  can  be  viewed  as  a 

lower  bound  on  the  amount  by  which  the  syscem 
(2.  l)-(2. 4}  exc eeds  the  stability  margin  speci¬ 
fications  (2.  5)— ;2.6>. 


In  general,  the  stability  conditions  - 

and  the  estimate  (4.  6)  of  excess  stability  mar¬ 
gin  -  of  Theorem  1  will  be  conservative. 

The  conservativeness  can  usually  be  reduced  by 
multiplying  equations  (2.  5)-(2.  6)  by  appropri¬ 
ately  chosen  positive  scalars  |  1 2  and 

I  aj(j'*,l  1 2  respectively  before  applying  Theorem 
1.  This  has  the  net  effect  of  substituting  ‘weight- 
ad1  uncertainty  bounding  matrices  (®i  R.; ,  “jS^) 
for  the  original  matrices  (Ri  .  Sj  ).  Further 
study  is  required  to  determine  the  extent  to  which 
it  will  be  practical  to  exploit  such  weighting  to 
reduce  the  conservativeness  of  Theorem  1. 


V.  Conclusions 


The  practical  importance  of  our  multiloop 
circle  theorem  is  that  it  provides  verifiable 
sufficient  conditions  for  the  stability  of  multi¬ 
loop  feedback  systems  using  only  crude  bounds 
on  system  parameters,  component  frequency 
responses,  and  nonlinearitiea.  Potential  appli¬ 
cations  include  the  testing  of  system  integrity 
in  the  presence  of  actuator  and  /  or  sensor 
failures  (cf.  [16)  )  and  the  characterization  of  the 
stability  margins  (e.  g.  ,  gain  (i  phase  margin)  of 
multiloop  feedback  designs  subject  to  simultaneous 
perturbations  in  gain  and  phase  in  the  feedback 
loops.  Thecrem  1  also  plays  a  key  role  in  bound¬ 
ing  the  response  of  systems  with  uncertain  dy¬ 
namics  [22]. 


Appendix 

In  this  appendix.  Theorem  1  is  proved  using 
the  sector  stability  criterion  of  [17],  [18],  [19]. 

We  begin  by  introducing  some  additional  termin¬ 
ology,  and  a  relevant  special  case  of  the  sector 
stability  criterion,  viz.  Theorem  Al.  We  then 
establish  via  several  lemmas  that  the  conditions 
of  Theorem  1  are  sufficient  to  ensure  that  the 
conditions  of  Theorem  Al  are  satisfied. 

Definitions^ -Con«<-,-,- );  strictly  inside,  outside): 


Given  any  three  operators  C,  R,  S.  we  define 


L2e  ~Cone  (£•  £•  S)  =  ^ 

(x,  £<*.y.T)  s  o 

for  all  r  e  R 

}  (Al) 

where 

+ 

F(x.X,i)  =  il  S(y  -  Cx  (|2 

-  II  Rx  II2 

(A  2) 

and  for  all  z,  z ^ ,  z^ 

:i  *  :IT  = 

V<  a.  a  >T 

(A3) 

<  *1-  Z  2  >T  = 

/  ’iT 

z^t)  dt^A4> 

0 


Given  an  operator  H  mapping  signals  x  into 
signals  y  ,  we  say 

H  strictly  inside  L,e  -Cone(C,  R,  S)  (A5) 

if  there  exists  an  «  >  0  such  that  for  every  pair 
(x,  y)  satisfying  y  =  Hx 

ils  (Y-Cx)il^  s  ,  Rx  ;i^  .  ,^||  x  :|^+  j|yj|2j  (A6) 

for  all  t  f  R^  . 

Given  an  operator  -G  mapping  signals  y  into 
signals  x,  we  say 

(-G^  outside  L,f  -  Cone  (C.  R,  S)  (A 7) 

if  for  every  pair  (x,y)  satisfying  x  =-Gy  we  have 

it  S  (y-Cx)  i|^  *  iRxIj.2  (A8> 

for  all  T  €  R 

+ 


Theorem  Al  Let  p  be  a  positive  integer; 
H.  (i=l,,.»,  p)  be  operators  mapping  x  into 
y^;  let  H  be  the  operator  * 


By  the  composite  system  property  o{  sectors 
(cf.  ,  Lemma  6. 1  (vi)  of  [  1  S] )  and  (All),  it  follows 
that 


H  strictly  inside  Sector 


where 


G  outside  Sector 


Theorem  A1  follows  from  Theorem  6.1  of  [18] 
(the  sector  stability  criterion).  C 


Theorem  A1  together  with  the  following  three 
Lemmas,  establish  Theorem  1. 


Lemma  A2;  Let  h(x  (t),t)  be  any  function  of 
x(t)  and  t  and  let  H  be  given  by 

(Hx)<t)  =  h(x(t),  t)  .  (Ai 

Let  C,  EL,  and  S  be  matrices  and  let  C,  R,  S 
be  the  operators  defined  by 

(Cx  )(t)  =  C  x  (t)  V-x  (A 2 


H.  strictly  inside  L 


is  L,  stable. 


Suppose  S  exists,  then 


Proof:  The  expression  (A2)  can  be  written 
equivalently. 


H  strictly  inside  L 


where 


(A15) 

(AI6) 

(A17) 


holds.  Then 


(A28) 


where 


m+n) 


Thus,  taking 


we  have  that  when  (A 27)  holds,  then 


;!s(jv  ( H(jjjj)  -  c(j^))xc  | 

s  liR(jo.0)  XQ  ||2  -  £  (  ||  XQ  if+H  HO-V  XQ  II2) 
s  ilRU'V  x0;|2  -  £  ||  X0  I!2  .  (A 39) 

CD 

Lemma  A4:  Lei  G,  C,  R,  be  linear-time- 
invariant  operators  with  respective  proper  ration¬ 
al  transfer  functions  H(s),  C(s),  R(s),  S(s).  Sup¬ 
pose  that  S  (s)  exists  and  has  a  proper  rational 
transfer  function  matrix  witi^  no  poles  ip  Re(s)20. 
Suppose  that  R,  G(I  +  C  G)  ,  and  S  are 
stable  and  nonanticipative.  Then, 


i!Ry||T2  =  ||  RG(I  +  CG)'lS‘'  v,jT2 

=  ||  RciitCGf1  s'1  vTi!T2 

by  the  nonanticipativeness  of 

a.  qiitcg  )  ,  s  ’ 

3> 

s/  :|(  lvT)(t)  if  dt 

I J 

D 

-  J  II  R(j-4  G(ju)  (1  +  C(ju)  G(jX))'1  s'  b-4 


(  -G)  outside  L,e  —  Cone  (C,  R,  S) 


(A40) 


V  Jja*  I  <*# 


if  and  only  if  anv  one  of  the  following  conditions 
hold  for  all  real  si 

i)  Xmin((I+C(-3^  C('jJ'))T  sT( -J-u)  S(M  (l+C(jX)(G(jJL))'1 
-GT(-j'4  RT(-;a)  R(j4  G(j-u)j  a  0  (A41a) 

U)  Xmin ((C >+  g”1(3'^)T ST1- J-k )  S(ja)(qjJJ)+G'1(ji-)) 

-RT(-j'JJ)  R(ysi))  a  0  (A41b) 

iii)  amin(s<  j^(c( 34  +  G ju))  2  1  (A41c ) 

iv)  amax(R0>d  G(ja)(l  +  C(jjj)  G(i4)'1  S'(j'U)j  M  . 

'  (A41d) 

When  G*\ju>)  and  R.~  \ j-JJ)  exist,  conditions  (A41a)- 

(A4ld)  are  equivalent. 


Proof: 

It  is  trivial  to  show  that  (A41a)  is  always  im¬ 
plied  by  (A4 lb)  -  (A41d)  and  that,  when  G  (jw) 
and  R*  (jui)  exist,  (A41a)  -  (A41d)  are  equivalent. 

Suppose  that  (A41a)  holds.  Let  (x,y)  by  any 
input-output  pair  satisfying  x  =  -Gy  ;  let 


v  =  S  (y  -  C  x  ) 


and  let 


if  0  *t  st 
otherwise  . 


(A42) 


(A43) 


Let  V  (ju)  denote  the  Fourier  transform  of  v_  . 
Note  that  from  (A41a),  it  follows  that  for  all 

,|Vljw)  J2  -  iiRfj'4  G(j4  (l_+  Qju)  G(jui))  ' 

VT(ju»  '.J2  a  0  .  (A44) 


by  Parseval's  Theorem 
and  the  hypotheses  that 
(  R,  Ga+CG)  .  andS*  ) 
are  stable. 

a» 

s  f  i|V(jdi|2d» 


=  i|S(y-Cx)||T2  .  (A45) 

Conversely,  suppose  that  (A40)  holds.  Let 
Yq  and  jJq  be  arbitrary.  The  letting  y-*Y  eiJiOt 
and  T-*=  we  have  from  (A40)  and  Parseval's 
Theorem  that 

i|R(j»0)C(j-«0)Y0  ,2  silSO'hjjMH-C^GOcyjV^2 
and  hence  (A41a)  holds.  1  ■  — .1 

This  completes  the  proof  of  Theorem  1. 
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ABSTRACT 

For  .Multi-Input-Multi-Output  (MIMO)  feedback,  systej?^  having  internal 
components  that  are  subject  to  parameter  variations,  nonlinearity,  or  un¬ 
modeled  dynamics  within  given  'conic  sector'  bounds,  tight  bounds  (which 
also  turn  out  to  take  the  form  of  'conic  sector'  bounds)  are  derived  for  the 
input-output  relation  of  the  closed-loop  system,  in  the  case  of  linear- time 
invariant  systems,  the  'conic  sector'  bounds  are  interpretable  in  terms  of 
the  maximal  singular  values  of  certain  frequency-response  matrices. 

INTRODUCTION 

One  of  the  main  motivations  for  the  use  of  feedback  in  control  system 
design  is  to  reduce  the  effects  of  plant  ignorance  on  system  response.  In 
the  case  of  single-input-single-output  (SISO)  feedback  systems  in  which 
plant  ignorance  limited  to  a  few  (typically,  1  or  2)  uncertain  parameters 
known  to  lie  within  specified  bounds,  the  Evans  root-locus  method  [1]  and 
Nichols  chart  frequency-response  method  [2,  p.  1971  are  very  useful  (cf. 

[3,  Ch.  e  1,14]).  In  both  cases,  one  graphically  constructs  'regions  of 
uncertainty’  containing  (for  all  possible  parameter  values)  the  corresponding 
representation  of  the  system  response.  In  the  case  of  root  ‘locus  approach, 
these  'regions'  are  the  set  of  values  assumed  by  each  of  the  system  poles 
as  system  parameters  vary  over  specified  ranges.  Similarly,  in  the  Nichol's 
chart  approach  the  'regions  of  uncertainty'  are  the  sets  of  values  assumed 
by  the  systems  open-loop  log  magnitude  versus  phase  plot  at  various  frequencies 
as  system  parameters  vary  over  specified  ranges.  Because  the  'regions  of 
uncertainty’ used  in  these  approaches  are  difficult  to  construct  for  systems 
with  more  than  one  or  two  uncertain  parameters  and  because  these  approaches 
are  incompatible  with  M1M0  systems  or  with  systems  having  nonlinear  or 
time-varying  plant  ignorance,  there  is  a  need  for  an  alternative  approach 
to  the  problem  of  bounding  the  effects  of  plant  uncertainty  on  closed-loop 
system  response.  The  results  of  this  paper  establish  that  ’conic  sector 
conditions’  provide  such  an  alternative  approach.  For,  linear  time-invarisnt 
systems,  these  conditions  can  be  expressed  in  terms  of  the  ’singular  values' 
of  certain  frequency  response  matrices. 


NOTATION  AND  PROBLEM  FORMULATION 

We  consider  the  class  of  systems  which  ‘can  be  represented  as  a  linear 
time-invariant  (LTI)  interconnection  of  N  uncertain  multi-input-multi- 
output  components.  It  is  assumed  that  an  'approximate'  LTI  model  (i  = 
1,...,N)  and  associated  transfer  function  matrix  C^(s)  is  available  for 
each  of  the  N  uncertain  components,  but  that  the  actual  system  components 
* 
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have  'perturbed*  input-output  relations  which  may  in  general  include  un¬ 
modeled  ' cross- couplings '  between  components  as  well  as  uncertainty  in  the 
input-output  relations  of  the  individual  components.  Thus,  we  are  con¬ 
sidering  the  class  of  systems  having  an  overall  input-output  relation 

X  = 

where  the  operator  ^  is  defined  by  feedback  equations  of  the  general  form 
(See  Figure  1)  rj£"l  Tu" 

=  H  (la) 

e  |f 


where 


l  =  +  «$>  ^  <lb) 

jj  is  an  LTI  operator  (having  transfer  function  matrix  H(s)) 
representing  the  internal  and  external  interconnections  of 
the  system's  components; 

$  =  diag  (^,  ;  (2)1 

represents  the  uncertain  perturbations  and  may  in  general 
be  nonlinear,  dynamical,  and  time-varying ; 


=  col  (£  , 


,  e  )  and 
“*N 


=  col  (f  ,  ...,  f  ); 
— 1  ~ N 


e.  and  represent  the  input  and  output  signals  respectively 
oi  the  i-th  'perturbed1  component; 

•  u  is  the  exogenous  input  to  the  system; 

•  £  is  the  observed  output  of  the  system. 

To  keep  the  mathematics  tractable,  it  is  assumed  that  H(s)  and  C(s)  are 
rational  transfer  function  matrices  —  this  is  not  a  serious  restriction 
since  most  systems  of  interest  with  non-rational  transfer  functions  can  be 
approximated  arbitrarily  closely  with  respect  to  the  L2-norm  by  systems 
with  rational  transfer  functions. 


Our  ignorance  regarding  the  accuracy  of  the  'approximate'  models  of 
the  system  components  is  assumed  to  be  bounded  by  an  Laconic  sector. 

Conic  sectors  are  defined  as  follows : 

Definition;  Given  any  three  compatible  operators  £,  £,  we  define 
I^-Cone  (£,  ^)  to  be  the  set  of  ordered  pairs  of  signals  (x,yj  e  x 

satisfying  ||^  -  £  s)  |  |  <  |  |$  x|  |  (2) 2 


For  any  collection  of  operators  ^  (i  =  1, _ ,n) ,  the  notation 

diag(A_ , . . .  ,A  )  is  defined  by  _  _  _  _ 

^  ^1  $1% 

dia9^i . '  -  • 

for  all  e^(i  =  1, . . . ,n) .  ^n  ^n^n_ 

2We  use  the  notation  L,,  to  denote  the  normed  space  of  cn-valued  signals 
£  s  R  -*•  C  for  some  integer  n^for  which  the  norm  |  |zj  |  A  <£,  z>  exists 
and  is  finite; ^<2^,  z2>  f  zj  (t)£0(t)dt  [5];  is2  the  2complex 

congugate  of  z -°° 


i.  oui.ua  o/  onu  output: 


radius  b. 

% 


u  ti  is  an  opej.ai.uc  wiui  cne  property  tnat 


is  Unstable  and  if  for  all  (x,£)  f  Lj  x  L2  with  £  =  H  x  we  have 

I  |S<Z.  -  C  x)  1  |T2  <  |  |B  *|  |. 


•l2  - 


(3) 

(4) ' 
236]) 


then  we  say 

JJ  A-Dr81??  L2~Cone  (£,  £,  S)  .  (End  of  Definition) 

It  is  a  trivial  consequence  of  Parseval's  theorem  (cf.  [5,  p. 
that,  in  the  case  of  I^-stable  LTI  operators  S,  and  6<£  ^  H-C  having 
respective  transfer  functions  S(s)  ,  R(s)  and  H(s)-C(s),  the  condition  (4) 
is  equivalent  to  the  frequency-domain  condition 

*1, 


°MAX  (£(3w'(H(jcLj)  ~  C(ju))  R  (j»>)  <  1 


(5) 


(where  a. 


s 


for  all  a) 

ma^(A)  denotes  the  largest  singular  value  of  the  complex  matrix  A 
i.e.,  the  square  root  of  the  largest  eigenvalue  of  A*A  (or  equivalently,  of  AA*) 
cf.  [7,  Ch.  1]).  The  motivation  for  the  designation  of  C,  R.  and  jS  as  the  center, 
input  radius,  and  output  radius  respective!  of  L_-Cone(C,  R,  S)  is  that 
in  the  special  case  where  H,C,R  and  S  are  SISO  and  LTI,  then  the  statement 
inside  L^-Cone  (C,  Hr  S)  implies  that  the  ^-dependent  function  Hugo)  : 

2  ^  ^\j  a,  •  •  •  • 

-*■  C  given  by  Y(jui)  =  H(ju)  U(jaj)  maps  inputs  U(jto)  lying  inside  the 
circle  of  radius  R(ja))  in  the  complex  plane  c  into  outputs  Y(juj)  lying  in¬ 
side  the  circle  of  center  C(jto)  and  radius  S(jio)  in  the  complex  plane  C. 

For  memoryless  operators  (H  x)  (t)  =  h(x(t) ,  t) ,  (C  x)  (t)  =  C  x(t)  , 

(R  x)  (t)  =  R  x(t)  ,  and  (S  %)  (t)  =  £5  y_(t)  ,  the  condition  (4)  is  equivalent 
to  the  condition 

1]S  (h(x,  t)  =  C  x)||Rn  <  ||Rx||Rn  (6) 

(where  1  |zj  |Rn  ^\|z^z  for  all  z  e  R°1  The  motivation  for  using  the  term 
’conic  sector'  comes  from  the  fact  that  in  the  special  case  where  S,  h(’), 

C,  and  R  are  scalar,  condition  (6)  implies  that  for  each  t  the  graph  of 
h(x,  t)  vs.  x  is  in  a  cone  shaped  subset  of  the  real  plane  —  cf.  [13]. 

Our  results  assume  that 

C  +  <5C  inside  L„-Cone(C,  R  ,  §  )  (7) 

“\j  'V  -  2  'll  'ViC  'VC 

where  c  is  as  in  equation  (1)  and  (R  ,  ^ )  are  given.  It  is  further 

assumed  that  (R  ,  S  )  are  L_-stable"'"&riaoperators  with  square,  rational 

transfer  function  matrices  f (s ) ,  S^ts))  having  the  property  that 

R  *(jw)R  (jw)  and  S  *(joj)S  (juj)  are  uniformly  positive  definite  for  all  to. 


and 


An  operator  H  is  said  to  be  L2~stable  if  H  x  L,,  whenever  x£L2 
further,  for  some  constant  k  <  °o  ,  |  |h  xj  )l  £  fii  |  |x|  [5]  . 

In  the  multivariable  generalization  of  the  circle  stability  criterion  in 
(6],  a  set  called  L2e-Cone(£,  R,  S)  is  employed  which  is  closely  related, 
but  different,  from  the  set  L2~Cone(C,  R,  S) .  In  general  neither  set  is  a 
proper  subset  of  the  other,  but  if  ji,  <£,  end  are  stable  nonantici- 
pative  operators,  then  it  can  be  shown  (using  the  definition  in  [6]  of 
L2e~Cone( •,*,*) )  that  H  inside  L2^-Cone(^,^,g)  if  and  only  if  [I  inside 
L2-Cone(C,  £,  S) . 


50f  course  R  ^(joj)  must  exist  for  (5)  to  be  equivalent  to  (4). 

6  T 

For  any  matrijj  A,  the  transpose  of  A  is  denoted  A  and  the  complex 

congugate  of  A1  is  denoted  A  . 


--  -  - 


In  the  special  case  when  there  is  no  ignorance  regarding  the  intercon¬ 
nection  structure  of  the  system  (i.e.,  when  the  perturbation  6C  contains 
no  'cross-coupling'  between  components) ,  then  6C  takes  the  special  form 


where  represents  the  ignorance  regarding  the  dynamics  of  the  i-th 

component  (i  =  1,  . . . ,  N)  .  If  there  are  conic  sector  bounds  available  for 
the  uncertainty  in  the  individual  components'  input-output  relations 


then  it  follows  (cf.  [9,  Lemma  6.2  (vi)  ]  ,  [10,  Lemma  4.2  (vi) ] )  that  (5) 
holds  with 


We  denote  by  the  LTI  operator  whose  transfer  function  matrix  is 
(suppressing  the  argument,  ’s') 


For  any  full  rank  rational  para-hermitian  matrix  A(s)  for  which  A(jcj) 
positive  definite  for  all  to,  we  denote  by  A-'-Z^(s)  the  rational  spectral 
factor  of  A(s)  (unique  to  within  a  constant  unitary  left  multiplier)  having 
the  properties  that  A(s)  =  ( h1//2(-s))T  A1/2(s),  that  (A1/2(s))~*  exists,  and 
that  A1/2(s)  and  its  inverse  have  no  poles  in  Re(s)  >  0;  &1/2 (s)  always 
exists  [8,  Theorem  2].  If  <A  is  an  operator,  not  necessarily  nonanticipa- 
tive,  whose  bilateral  Laplace  transform  transfer  function  matrix  is  proper, 
rational,  para-hermitian  and  has  the  property  that  A(jw)  is  uniformly 
positive-definite  for  all  to,  then  denotes  the  nonanticipative  minimum 

phase  LTI  operator  having  transfer  function  A^/2(s).  Given  any  L^-stable 
LTI  operator  ^,-we  denote  by  ^  the  L  adjoint  operator;  i.e.,  denoting  by 
Ag(t)  the  impulse  response  matrix  of  ^  is  the  LTI  operator  with 
impulse  response  matrix  A^(-t) .  Note  that  if  A(s)  is  the  bilateral 
Laplace  transform  transfer  function  matrix  of  then  AT(-s)  is  the 
transfer  function  matrix  of  A*  and  further  AT(-jco)  =  A^(jw)  . 


MAIN  RESULT 


Our  main  result  is  the  following  theorem  giving  tight  bounds  on  the 
overall  systems  input-output  relation  T. 


Theorem  1:  Suppose  that  (7)  holds.  If 
(a)  uniformly  for  all  to 


min 


(A)  denotes  the  smallest  singular  value  of  A) ,  and 


min 


v-fi.  axx  uj| 


men,  provxaea  1*^1  }u>)  xs  £UXX  LaitJV  *• 

£  inside  L2-Cone  (T^,  pJ/2,  $2) 


(13) 


where  ^Qom»  and  are  the  (not  necessarily  causal)  I^-stable  LTI 

operators  specified  in  terms  of  their  bilateral  Laplace  transform  transfer 
matrices  by 


T _ .  (s)  ^L..,(s)  +  i.„(*)(4(“s>5e(8>  "  tev{‘s)^c("s)Sc(s)^ev(s))"1 


— nom 


-yu 


-yv 


-ev 


— ev 


— ev  — c  — c  — eu 


(14) 


SjC=)  £  (i,v(s>(^ ('S|VS>  ‘  iev(-sl4<-s)Scu,^vlsl)"15v<"s’)’1  <15' 

£r<=>  i  -  £0<»liev!*l(4<-s>2c<s>)'1£ev(-s>4("sl)’1 


*  R  (s)L  ;s). 
— c  — eu 


(16) 


1/2  1/2 

Moreover,  the  set  L^-Cone  (£  ,  £T  ,  O'  )  is  the  tightest  possible  bound 

on  T  in  the  sense  that  for  every  pair  of  signals  (ii,  y)  e  L2~Cone  (^no_» 

'  1:1161:6  exists  at  least  one  'perturbation'  satisfying  17) 
such  that  £  =  £  u. 


Proof.  See  Appendix 


DISCUSSION 

The  uncertainty  bound  provided  by  Theorem  1,  like  the  uncertainty 
bound  on  the  plant  ignorance  takes  the  form  of  an  Laconic  sector 
condition.  Consequently,  in  the  special  case  in  which  the  perturbation 
6C  is  linear- time- invariant,  Parseval's  theorem  [5,  p.  236)  implies  that 
the  Laconic  sector  bound  on  the  overall  system  input-output  relation 
provided  by  Theorem  1  can  be  expressed  using  singular  values  giving  the 
bound  on  the  system's  frequency  response  matrix 

amax(2T/2(ju)  (T(jw)  "  Tnom(ju))  1 

cf .  equation  (5) .  In  particular  for  single-input-single-output  LTI  systems 
having  uncertain  LTI  components,  this  bound  becomes 


,2  PT(jU) 
lT(jU,)  "  Tnom(ju)'  - 


7  For  nonanticipative  systems,  Lj-stability  is  implied  by  L.  -stability 
(which  is  defined  in  [6J).  It  can  be  shown  that  if  the  system 
(1)  is  nonanticipative  and  is  L2e-stable  when 
5c  =  0,  then  (l2)  is  sufficient  to  guarantee  that  (1)  is  L2e-stable  tor 
all  5c  satisfying  (7)  16).  Consequently,  at  least  for  nonanticipative 
systems,  condition  (b)  of  Theorem  1  is  not  very  restrictive  and  may  be 
easily  verified  by  checking  that  is  L^-stable. 


Theorem  1  gives  the  tightest  possible  bound  on  the  overall  system 
input-output  relation  T  only  when  all  available  information  about  the 
perturbation  5  C  is  contained  in  condition  (7)  .  This  is  an  important 
limitation,  since  in  general  this  will  not  be  the  case.  For  example,  if 
bounds  on  system  uncertainty  are  given  in  the  form  of  (8)  then,  although 
condition  (7)  holds  with  R  and  S  specified  by  (9) -(10) ,  condition  (7) 
does  not  retain  the  'structural'  “information  that  5c  is  diagonal  (i.e.,  that 
6  ^  has  no  'cross-couplings'  between  components).  Consequently,  in  such 
situations  one  may  in  general  expect  the  bound  provided  by  Theorem  1  to 
be  conservative.  In  contrast,  the  classical  root-locus  and  frequency- 
response  methods  (cf.  [3,  Ch.  6]  and  [4])  for  generating  'regions  of 
uncertainty'  (viz.,  root  loci  and  frequency  response  ’templates’)  to  bound 
system  response  need  not  be  conservative.  Thus,  the  response  bounds 
provided  by  Theorem  1  are  the  most  useful  in  the  case  of  systems  for  which 
these  classical  approaches  are  impractical  or  inapplicable.  Such  systems 
include  multiloop  feedback  systems,  multi- input-multi-output  systems, 
systems  with  more  than  a  very  few  uncertain  parameters,  and  systems  with 
nonlinear  components. 


The  problem  formulation  used  in  this  paper  is  sufficiently  general  to 
accommodate  multiloop  'two  degree  of  freedom'  (cf.  [12,  §6.1],  [4]) 
feedback  structures  with  plant  parameter  ignorance  such  as  depicted  in 
Figure  2.  For  this  configuration,  one  finds  that  the  transfer  function 
matrix  L(s)  of  (11)  is  given  by  (suppressing  the  argument  ’s') 


L 

-yu 


L 

-yv 


L  1  L 
— eu  1  — ev 


Gq  C(I  +  F  C)-1P 


G^(I  +  C  F) 


-1 


-1 


(I  +  F  C)  P  I  ~F(I  +  C  F) 

l  ;  ~'j  l 

where  F  _  Gp  +  fij  Gc  GpC  and  P  _  Gjc  G^  GpC-  As  one  might  expect 

based  on  the  work  of  Horowitz  at  al.fe.g.,  [4],  [12]),  it  can  be  shown. using 
Theorem  1  that  the  'two  degree  of  freedom’  structure  of  Figure  2  permits  one 
to  adjust  the  amount  of  system  uncertainty  and  the  nominal  value  T  of 
the  closed-loop  system  input-output  relation  independently  ^oQm  a 
certain  extent  — -  this  is  the  subject  of  a  forthcoming  paper. 
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APPENDIX 


Proof  of  Theorem  1 


We  begin  by  establishing  a  useful  lemma. 

Lemma  Al:  If  2«c11Xn  is  a  positive  definite  hermitian  matrix  and  if 
J3  «  crxn  is  a  matrix  of  full  rank  r  <_  n,  then  the  matrix  t)  =  (BQ_~1B*)“1 
exists  and  has  the  following  properties: 

i)  (J).  -  B  is  positive  semi  definite; 

ii)  if  _S  is  any  matrix  such  that  £  -  B*S  B  is  positive  semi  definite, 
then  2?  -  S  is  positive  semidefinite 
+  *  +”  +  *  *\,  + 

ill)  (B)£B  =  (B  )  B  J  B  B  (Al) 


■  -  l  l  ,1  if— . .  ' 


i 


a  =  k  ii  k 


(A2) 


Proof ;  For  any  positive  definite  matrix  M  and  any  positive  integer  m, 
letCjJ  denote  the  inner  product  space  of  complex  m-vectors  with  inner 
product  <z^ ,  z^>  4  zf  _M  z^.  Consider  B  as  a  linear  mapping  into  C^. 
Then  the  adjoint  of  B,  which  we  denote  as  Ba,  is  u 

a  -1  * 

1  =  £  B 

*  x  + 

(recall  13  denotes  the  complex-conjugate  of  B  )  and  B  is  the  pseudo¬ 
inverse  of  B  [11,  pp.  150-165] .  Further, 

h,  »  -i  *  -i  -1  *  -i  -1  *  -1  *  -1 

2  5  (BQ  B  )  =  ( (B  Q  B  )  XB  Q  )Q(Q  B  (B  Q  B  )  ) 


.  +  *  -f 
<B  >  £  B  . 


(A3) 


For  any  vector  xeC^  ,  let  2nra)  and  denote  t^le  respective 

projections,  of  x  onto  the  nullspace  of  B  and  the  orthogonal  complement 
of  the  nullspace  of  j3.  Now,  for  any  x£  and  any  y  «  C ^ 


“  --  "  V(B) 

+ 

B  B  y^  =  y  . 

It  follows  that  for  all  x 

*  *  'Xj 

x  (Q  -  B  Q  B)  x 


(A4) 

(A5) 


2tub)S,Si(b)  1  0 


which  establishes  property  (i) .  For  any  matrix  S  satisfying  Q  -  B  S  B  >  0 


and  any  jy  €  C £  we  have 

* 

y  S  y 


1  (£®+)  *  S  (B  eT*" )  y 

+  *  *  + 

(_B  _£)  B_  j3  B  (B  y) 

(B_+  J)*  Q  (B+  y) 

*  ^ 

y  Q  y 


(A6) 


which  establishes  property  (ii) .  The  identity  of  property  (iii)  follows 
by  direct  substitution  of  (A2)  into  (Al) . 

We  now  prove  that,  under  the  conditions  of  Theorem  1,  equation  (13) 
holds.  We  begin  by  noting  the  input-output  relation  ^  ^  u.  defined  by 
(1)  can  be  described  equivalently  by 


"  l 

L 

l  “ 

s 

tfcyu- 

+  L  v 
»tyV  — 

e. 

\ 

-  ^veu  — 

+  L  v) 
'tev  —  J 

(A7) 


(A8) 


we  take  (u,  £,  e,  f,  v)  to  be  a  solution  of  (1)  and  (A7)  .  For  any  xeL 
and  any  L^-stable  operator  we  use  the  notation  §  and  ft  to  denote  the2 

z  and  frequency  response  of  A  respectively. 


Fourier  transform  of 


r 


Suppose  that  (7)  holds.  Then  (e,  f)  e  L„-Cone  (C,  R  ,  S  )  and  hence 

—  —  i  a,  a.c  %  c 

o  >  Ifea-atili  “  -  ll^ail* 


(A10) 


(A12) 


(A13) 


(A14) 


(A15) 


Thus,  applying  part  (i)  of  Lemma  Al,  we  have  from  (A9 


nom 


nom 


(A17) 


from  which  (13)  follows 


•  r 


T! 


i  • 


specified  by 


where 


■\j  — 


~  + 

yv 


L  + 
yv 


,  u)  +  T  u 

(A18) 

yu  v 

/V  A—  1  A  *  —  1 

(L  Q  L  ) 

yv  V  yv 

(A19) 

Then,  (u,  y,  v)  are  consistent  with  (1)  and  (A7)  and  (using  part  (iii)  of 
Lemma  (Al)  and  Pars eval’s  theorem)  it  follows  that  for  all  (u,  t  L  - 

Cone  <w  4  ■  4/2> 

o  >  IISi/2(f  -  *  smf 

1  '  nom  > 


4/2  “  1 1 


2  •  “2 

A  /V  /V  —  2.  A  *  —  2  A  A  A  A 


A  A  A  A  "  A  A—  I  A  «  —  I  A  A  /A  A 

=  <  (v  -  T  u)  ,  L  (L  Q  L  )  L  (v  -  T  u)  > 

v  yv  yv  V  yv  yv  v  '  l. 

-  <  U,  P_  U  > 

T  L_ 


-  I  fee  «  -  S*>l  I 


M'l: 


(A20) 


where  the  latter  equality  follows  as  in  (A9) .  Let  6  £  be  the  map  defined 
by 

^  2 

6  £  £  =  I  ^  1  |  ^  ^  z  >  L  v.  (A21) 

Using  (A20)  and  the  Schwartz  inequality,  one  readily  verifies  that 
e  =  v  and  that  <5  £  satisfies  (7). 

(End  of  proof) 
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ABSTRACT 


We  study  the  fundamental  properties  of  feedback  for  nonlinear, 
time-varying,  multi-input,  multi-out put .distributed  systems.  The 
classical  Black  formula  is  generalized  to  the  nonlinear  case.  Achievable 
advantages  and  limitations  of  feedback  in  nonlinear  dynamical  systems 
are  classified  and  studied  in  five  categories:  desensitization, 
disturbance  attenuation,  linearizing  effect,  asymptotic  tracking  and 
disturbance  rejection,  stabilization.  Conditions  under  which  feedback  is 
beneficial  for  nonlinear  dynamical  systems  are  derived.  Our  results  show 
that  if  the  appropriate  linearized  inverse  return  difference  operator  is 
small,  then  the  nonlinear  feedback  system  has  advantages  over  the  open- 
loop  system.  Several  examples  are  provided  to  illustrate  the  results. 
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I. 


INTRODUCTION 


Feedback  is  one  of  the  most  important  engineering  inventions. 

Historically  [1],  some  third  century  B.C.  water  clocks  may  be 
viewed  as  primitive  feedback  devices.  Some  more  definite  feedback 
systems  such  as  furnace  temperature  regulators,  float  regulators, 
windmills,  etc.  were  invented  between  the  16th  and  18th  century.  However, 
it  is  only  at  the  turn  of  the  19th  century,  when  James  Watt  invented  the 
steam  engine  governor,  that  the  concept  of  feedback  began  to  be  appreciated 
and  used  by  engineers.  Attempts  to  understand  and  to  analyze  the  associ¬ 
ated  stability  problems  brought  by  feedback  were  then  made  by  several 
pioneers,  e.g.  Airy,  Maxwell,  Lyapunov,  Routh,  Hurwitz,  Vyschnegradskii ,  etc. 
Up  to  the  1920's,  feedback  devices  were  predominantly  mechanical  regulators 
whose  primary  objective  was  to  reduce  the  regulated  error  to  zero.  The 
need  of  long  distance  telephony  in  the  1920's  [2]  resulted  in  the 
crucial  invention  of  the  negative  feedback  amplifier  by  H.S.  Black  [3,4]. 
Black's  major  invention  was  to  conceive  the  benefits  of  feedback  resulting 
from  a  high  forward-path  gain:  he  fed  the  output  back  to  the  input  stage; 
he  showed  that  by  using  a  high  gain  In  the  forward  path,  one  obtains 
an  amplifier  which  is  1)  more  1  inear  than  the  vacuum  tubes  in  the  forward 
path,  2)  insensitive  to  variations  in  the  vacuum  tubes  in  the  forward 
path,  and  3)  insensitive  to  noise  injected  at  the  output  stage.  Depend¬ 
ing  on  the  applications,  the  requirements  on  negative  feedback  amplifiers 
and  on  mechanical  regulators  may  be  quite  different.  Nevertheless, 
during  World  War  II,  the  need  of  very  accurate  servomechanisms  for 
anti-aircraft  defense  brought  them  together.  It  is  our  opinion  that 
there  is  a  unified  underlying  discipline  o_f  feedback:  different  applica¬ 
tions  emphasize  different  aspects  of  that  discipline. 


In  practice,  feedback  is  indispensable  in  many  system  designs 
because  of  1)  uncertainties :  typically,  incomplete  knowledge  of  the  plant 


due  to  plain  ignorance'  or  to  the  inordinate  cost  of  measurements; 
unpredictable  environmental  effects;  manufacturing  tolerances;  changes 
in  the  characteristics  due  to  ageing,  wearing,  loading,...;  etc.,  and  2)  the 
use  of  inherently  unstable  plants,  o.g.  rockets,  some  chemical  reactors,  some 
nuclear  reactors,  some  advanced  design  airplanes,...,  etc.  The  effective- 

El  * 

ness  of  feedback  in  coping  with  uncertainties  was  actually  illustrated  in 

» 

the  process  of  Black's  invention  of  the  negative  feedback  amplifier  [A]: 
he  realized  that  an  "open-loop"  cancellation  scheme  is  impractical 
(because  it  requires  the  two  "paths”  track  each  other)  and  he  eventually 
conceived  the  negative  feedback  amplifier.  Moreover,  Black's  paper  [3] 
exhibited  many  of  the  achievable  advantages  of  feedback  such  as  desensi¬ 
tization  and  disturbance  attenuation. 

Even  though  most  of  the  existing  expositions  of  the  effects  of 
feedback  are  essentially  based  on  transfer  functions  calculations  (thus 
necessarily  restricted  to  the  linear  time-invariant  case  only),  we  believe 
that  the  benef its  of  feedback  are  the  consequence  of  two  facts :  f irst , 


a  topological  structure  -  the  loop;  second,  an  order  of  magnitude 
relation  (in  the  context  of  Black's  classical  paper  [3],  it  reads  i  Bp J  >>  1) 
which  is  independent  of  Jdie  linearity  requirement .  Pursuing  this  point 
of  view,  we  derive  below  the  basic  properties  of  feedback  in  a  much  more 
general  framework:  we  make  full  use  of  the  recent  developments  in  the 
input-output  formulation  of  nonlinear,  distributed,  time-varying,  multi¬ 
input,  multi-output  systems  (see  e.g.  [3, 6, 7, 8]).  Such  formulation 
allows  for  unstable,  continuous- time  as  well  as  discrete-time  subsystems; 


i.e.  considering  only  the  time  interval  [0,T],  with  T  finite  but  arbitrary. 
The  contents  of  this  paper  are  as  follows. 

I.  Introduction 

1.1  Notation.  1.2  General  framework 

II.  Black's  formula  generalized 

III.  Advantages  and  limitations  of  feedback 

111.1  Densensitization.  III. 2  Disturbance  attenuation. 

III. 3  Linearizing  effect.  III. 4  Asymptotic  tracking  and  distur¬ 
bance  rejection.  ITI.5  Stabilization 

IV.  Conclusion 
References 
Appendix 

I . 1  NOTATION 

Let  It  (<E)  denote  the  field  of  real  (complex,  resp.)  numbers.  Let 
IN  denote  the  set  of  non-negative  integers.  Let  denote  the  set  of 
non-negative  rational  numbers.  Let  1R+  denote  the  non-negative  real 

O 

line  (0 ,°°) .  Let  C+  denote  the  open  right-half  complex  plane. 

Let  R[s]  CR(s))  be  the  set  of  all  polynomials  (rational  functions,  resp.) 

in  s  with  real  coefficients.  Let  RpXC*  (CpXCi,  Rfs]pX<*,  R(s)pXC*)  denote 

the  set  of  all  p*q  matrices  with  elements  in  R  (C,  R[s],  R(s),  resp.). 

Let  dp(s)  denote  the  degree  of  p(s)  £j[s].  Let  O''  C  R+  be  the  set  of 

time,  instants  at  which  various  signals  of  interest  are  defined:  typically, 

*7  =  1R+  for  the  continuous-time  case,  *  H  for  the.  discrete  time  case. 

in  be  a  normed  (seminormed)  space  of  functions  mapping  into  some 

vector  space  'If,  (typically,  V  =  Rn,  =  l.'\  Ln  or  «.”,  £n,  etc.). 

Z  00  Z  00 

Associated  with  the  normed  (seminormed)  space is  the  extended  normed 


(seminormed)  space  defined  by  ‘~tW^  :  =  {f:3"  -+,lf\  VT  €E  O' ,  |  f  |  <  <*>}  , 

where  jf|^  :=  |f^|,  f^.  is  obtained  from  f  by  a  projection  map  P^,  more 

ff(t),  t  <  T 

precisely,  fT  :=  PTf  is  defined  by  fT(t)  =|  >  for  t,  TG^.  Let 

P  ^7/  denote  the  class  {P  }.  Let  H:-/#  -*-m  ;  H  is  said  to  be 

•«i  e  -1  e  ~  e  e 

causal  iff  P?HPT  =  PTH,  VT  e  O'  [8,  p.38-39].  "Nonlinear"  means  "not 

necessarily  linear".  means  "Is  defined  by",  "u.t.c."  means  "under 

these  conditions".  Operators,  i.e.  maps  from  7>1  into  1T1  ,  are  labelled 

e  e 

by  boldface  symbols  (e.g.  G,K,F,...).  Let  denote  the  t2~norm  on  ®n. 

Let  denote  the  class  of  continuously  differentiable  maps  [19,  pp.  172], 

We  write  a  <<  b  to  mean  that  a  is  very  small  compared  to  b. 


1 . 2  GENERAL  FRAMEWORK 


We  will  consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1, 


where 


(1) 


G:  -*  ye,  is  a  nonlinear,  causal  operator  representing 

the  plant , 

K:  ^  -*■  IL  ,  is  a  nonlinear,  causal  operator  representing 
the  compensator , 

F:  it  -*•<?,  is  a  nonlinear,  causal  operator  representing 
~  » e  e 

the  feedback, 

r  €  ^  ,  is  the  system  input , 
u  £  is  the  plant  input , 
y£^,  is  the  system  output, 
e  £  ^e>  is  the  error  signal, 

are  extended  normed  spaces,  unless  otherwise 

stated  (hence  P„,R  ,etc.  are  normed  spaces  with  norm 

-  I  e 

denoted  by  | • | ) . 


(1.1) 

(1.2) 

(1.3) 

(1.4) 

(1.5) 

(1.6) 

(1.7) 

(1.8) 
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We  shall  assume  that 


(I+FGK)  ^  is  a  well-defined  nonlinear,  causal  operator  (1.9) 

mapping  from  ^  into  . 

For  specific  conditions  under  which  assumption  (I. 9)  holds,  see  for  example 
[7,  sec.  2.8;  8,  pp.  47].  Note  that  the  closed-loop  input-output  map 
H  :  r  -*■  y  is  given  by  GK(  I+FGK)  ^ . 


II.  BLACK’S  FORMULA  GENERALIZED 

H.S.  Black's  invention  of  the  negative  feedback  amplifier  was 
based  on  the  following  analysis  [3]:  consider  the  feedback  system  S 
shown  in  Fig.  I.l;  let  GK  and  F  be  specialized  into  the  scalar  transfer 


functions  p  and  3,  respectively, 

(2) 

transfer  function  is 


then  the  closed-loop  input-output 


(11. 1) 

(11. 2) 

(11. 3) 


Black's  crucial  observation  is  that  for  those  frequencies  where 
j  By  1  »  1,  or  equivalently  j  l+(3p  J  »  1,  the  output  y  ~  g  r’  *,e,»  t*,e 
closed-loop  input-output  transfer  function  is  essentially  Independent 
of  p  and  is  essentially  specified  by  8.  So  the  recipe  is:  B  is  speci¬ 
fied  by  the  desired  h  and  the  forward  path  gain  p  is  made  as  large  as 
possible  to  achieve  (II. 3). 

Equations  (II.I)-(II .3)  summarize  Black’s  fundamental  observation. 

We  note  that  it  is  valid  because  1)  there  is  a  loop  structure,  and  2)  the 


loop  gain  | B|i  |  is  large.  This  reasoning  can  be  greatly  generalized  to 
the  case  of  nonlinear  system  S  shown  in  Fig.  1.1.  Note  that  in  the 
linear,  time-invariant  case,  we  only  have  to  consider  the  sinusoidal  in¬ 
puts  within  some  frequency  band  of  interest  and  the  corresponding  sinu¬ 
soidal  steady-state  response.  But  in  the  nonlinear  case,  we  have  to 
formulate  the  condition  i.i  terms  of  inputs  of  interest,  e.g.,  sinusoids 
of  various  frequencies  and  amplitudes,  step,  ramp,  parabolas,  etc. 


Theorem  I 1.1:  (Black's  formula  generalized;  soft  version) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig  1.1  and 

described  by  Equations  (I.l)-(1.9).  Let  ft.  C  be  the  set  of  inputs 

a,e  e 

of  interest.  U.t.c.  if,  for  T  sufficiently  large, 

| (I+FGK)_1r|T  «  | r | T ,  Vr  £  ^  g  (II. 4) 

then,  asymptotically 


on 


(II. 5) 


in  the  sense  that,  for  T  G  3  sufficiently  large, 

lr  -  ?  «yr  rlT  «  MT,  Vr  G  (Rd>e  (II. 6) 


Proof : 

Since  F,  G,  K  are  nonlinear,  we  have 


H  =  GK(I+FGK)_1. 
~yr  ~~  - - 


Apply  the  nonlinear  operator  F  on  the  left  to  both  sides  of  this  equation: 


F  Hyr  =  FGK(I+FGK) 

-1 


I  -  (I+FGK) 


Hence  for  all  r 


r  -  F  H  r  =  (I+FGK)  r 


Now  let  r  £  ^  C  ft  and  let  T  ^  J  be  large,  then,  using  (II. 4) 


|  (I+FGK)  r 


and  (II. 5)  follows 


Remarks  II.l:  a)  (II. 5)  says  that  the  feedback  system  H  followed  by 


F  behaves  approximately  like  an  identity  operator  as  far  as  the  inputs 


of  interest  are  concerned.  Equivalently,  F  is  an  approximate  left-inverse 


H  is  essentially  independent  of  G  and 


is  essentially  specified  by  F.  (The  left  inverse  is  the  one  of  interest 


there  always  exists  a  Q  such  that  PQ  =  I  where  I  denotes  the  identity 


b)  Consider  C  perturbed  into  G;  call  H  the  resulting  closed-loop 


input-output  map.  If  G  satisfies  (II. 4),  then  F  H 


H  is  insensitive  to  the  plant  perturbations.  This,  however 


does  not  assert  that  the  relative  change  in  H  will  be  much  less  than 


that  ir.  G;  it  simply  asserts  that  changes  in  G  have  little  effect  on  H 


The  exact  relation  between  the.  relative  change  in  H  and  the  relative 


change  in  G  is  given  by  Equation  (III. 7)  below  and  discussed  in  Remarks 


To  obtain 


requires  some  additional  assumptions.  This  is  done  In 


Theorems  11.2  and  II. 3  below 


Note  that  eqn.  (II. 1)  gives  the  exact  relation 


h 

yr 


1 

B 


I  1 

B  *  l+6u 


(II. 7) 


As  feedback  designers  know  (see  e.g.  [9]),  it  is  often  advantageous  to 
write  this  equation  in  terms  of  the  "inverse  loop-gain" 


1  =  _  1  (Bu)"1 
6  B  1+(BM)_1 


(II. 8) 


Theorem  II. 2  below  generalizes  Black's  result  to  the  nonlinear  case: 
an  estimate  of  the  difference  H  r  -  F  ^r  is  obtained  under  the  condition 

~yr 

that  the  "inverse  loop-gain"  is  small  for  the  class  of  inputs  of 
inter est.  Note  the  similarity  in  form  between  the  right-hand  sides  of 
eqn.  (II. 7)  and  eqn.  (TI.9)  below. 

Theorem  II. 2  (Generalized  Black  formula) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and 
described  by  eqns.  (1.1)— (1.9) .  Let  ^  g  C  be  the  set  of  inputs  of 
interest.  Suppose  that 


(al)  VT  (=3*,  PT^  is  a  Banach  space; 

(a2)  F-1:  ^  -*■  iL  and  (FGK)”1:  ^  are  well-defined  nonlinear, 

causal  maps; 

(a3)  (FGK)  is  continuous^  on  Re,  and  for  each  r£  ^ 

zn+l  :=  r_  (FGK)_1zn  €  c  where  zQ  -  r,  n 

and  /V(/?  .  )  denotes  a  neighborhood  of  .  in  /?  . 


d,e  -1 
(I+FGK)  r 


(FGK)  r  - (FGK)  r 


l-Y-l(FGK)  a] 


In  particular.  If  for  T  sufficiently  large 


YTl (FGK)  ]  «  l 


(FGK)  r 


then  asymptotically 


in  the  sense  that  for  T  G^T  sufficiently  large 


Proof  of  Theorem  II. 2;  see  Appendix 


Remark  II. 2:  Note  that  the  classical  Black  c 


(which  is  achieved,  in  design,  wLth  |y|  »  1)  is  a  sufficient  condition 


for  the  approximation  (II. 2).  Thus  one  may  want  to  pursue  the  idea  of 


small  inverse  forward  path  gain  (iarge  |p|  in  the  single-input  single¬ 
output  case)  as  follows:  assuming  the  existence  of  the  required  inverses, 
from 


Hyr  =  GK(I+FGK) 


-1 


ill.  14) 


we  obtain 


H~*  =  (I+FGK)  (GK)-1 


=  F  +  (GK) 


-1 


(11.15) 


This  formula  is  the  generalization  to  the  nonlinear  case  of  the  well- 
known  corresponding  relation  with  matrix  transfer  functions  [9,  p.  121], 
If  we  assume  that  Vy  €:  the  set  of  outputs  of  interest,  and  for 

T  sufficiently  large 


(GK)_1y|T  «  |Fy|, 


(11.16) 


then,  asymptotically 


H-1  a  F  ,  on  \L, 
~yr  «d,e 


(11.17) 


in  the  sense  that  for  T  £ J"  sufficiently  large,  |H^y-Fy|T  <<  | Fy | T , 

Vv  £  U'.  .  Note,  however,  since  F  and  H  are  nonlinear,  eqn.  (11.17) 

1  «d,e  ~  ~yr  - 

-1  „ 

does  not  imply  that  H  -  F  “ 

-  ~yr 

Going  back  to  the  Black  formula  (II. 1),  we  note  that  the  approxima¬ 
tion  (II. 2),  hyr  =  is  valid  as  long  as 


Is-Tssri  «  is' 


(11.18) 


Theorem  II. 3  below  generalizes  this  condition  to  the  nonlinear  case: 

eqn.  (11.18)  should  be  compared  with  the  condition  (ii)  of  Theorem  II. 3  below. 


Theorem  II. 3 


Consider  the  nonlinear,  feedback  system  S  shown  In  Fig.  1.1  and 


C  be  the  set  of  inputs  of 
well-defined  nonlinear,  causal 


described  by  eqns 


interest.  Suppose  that  F 


sup 

,  Te^r 

u,e 

(I+FGK)  r 


for  T  G  2T  sufficiently  large 


A(F  ) • | (I+FCK)  r 


then,  asymptotically 


in  the  sense  that  for  T  €3''  sufficiently  large 


Proof  of  Theorem  II. 3:  see  Appendix 


Corollary  II. 3.1  (F  linear) 


Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and  described 


be  a  well-defined 


by  eqns.  (1.1)— (1.9) .  Let  F  be  linear.  Let  F 


be  the  set  of  inputs  of  interest 


linear  causal  map.  Let  tj( 


U.t.c.  if  for  T  sufficiently  large  and  V  y  €  F 


(T+CKF)  y 


then  conclusions  (11.19)  and  (11.20)  hold 


Proof  of  Corollary  II. 3.1 


:ee  Appendix 


Corollary  If. 3.2  (Linear  time- invariant  case) 


Consider  the  feedback  system  S  shown  in  Fig.  1.1  and  described  by 


eqns .  (I.l)-(1.9).  Let  the  operators  C,  K,  and  F  be  linear,  time-invariant 


and  represented  by  transfer  function  matrices  G(s),  K(s)  and  F(s) 


respectively.  Let  ^  C  ft  consist  of  all  sinusoidal  inputs  with 


frequencies  in  some  interval  51  C  JR.  Suppose  that 


is  a  well-defined  causal  map 


the  closed-loop  system  is  exp.  stable,  i.e.  the  impulse  response 


of  the  transfer  function  li 


r  »  y  is  bounded  by  a  decaying 


U.t.c.  ,  if  Via  €  (I,  Vy  €  range [F(1co)  ]  C  C 


|  [  (I+GKF)  ( jio)  y  |  «|y 


Proof  of  Corollary  II. 3.2:  see  Appendix 


Remark  11.3.2;  If  we  use  the  2.„-norm  in  (I 


condition  (11.21)  is  satis 


fied  if  the  largest  singular  value 


of  [  (I+GKF)  (Juj)  ]  is  much  smaller 


than  1,  for  all  u)  G  ft 


Comments  on  Theorems  11.2  aud  IT.  3: 

(a)  Theorems  II. 2  and  II. 3  conclude  that,  under  suitable  conditions,  the 
output  y  =  H^r  is,  asymptotically  (i.e.  for  large  T),  approximately  equal 
to  F  r  over  the  inputs  of  interest  within  a  small  relative  error.  Thus 
eqns.  (11.12)  and  (II. 19)  are  complete  generalizations  of  the  Black  formula 
(II. 2)  to  the  nonlinear,  time-varying,  multi-input,  multi-output,  distrib¬ 
uted  systems  S  shown  in  Fig.  l.L  and  described  by  eqns.  (I.l)-(1.9). 

(b)  Typically,  ,  the  set  of  inputs  of  interest,  consists  of  sinusoids 

a ,  e 

of  various  frequencies  and  amplitudes,  or  steps,  ramps,  parabolas,  etc., 
of  various  magnitudes. 

(c)  Note  that  the  extended  spaces  framework  allows  us  to  treat  the  case 
where  some  of  the  operators  G,  K,  F  may  be  unstable  and  to  state  asymptotic 
conditions  such  as  eqns.  (11.10),  (II. 11). 

(d)  It  is  the  nonlinearities  of  the  maps  G,  K,  F  which  forces  us  to  use 
the  incremental  gain  (e.g.  Y^l ( FCK)  ')  in  theorem  TI.2),  or  Lipschitz 
constants  (e.g.  X(F  ^)  in  theorems  II. 2  and  II. 3),  over  appropriate  sets, 
to  obtain  our  estimates.  In  the  linear  case,  one  would  use  the  induced 
norms  of  the  corresponding  maps  over  appropriate  sets. 

(e)  Theorems  II. 2  and  II. 3  have  important  design  implications:  Given  a 
plant  G,  we  first  choose  F  such  that,  over  the  inputs  of  interest,  F  ^  is 
asympotically  the  desired  input-output  map.  Next  we  choose  the  compensa¬ 


tor  K  so  that  the  conditions  of  theorem  II. 2  (or  of  theorem  II. 3)  are 
satisfied.  Then,  asymptotically ,  the  closed-loop  input-output  map  is 
close  to  F  1  over  the  inputs  of  interest  ns  we  desired. 

(f)  Note  that  F  ^  can  be  nonlinear .  A  simple  well-known  example  of 
realizing  a  nonlinear  map  by  a  feedback  system  (with  large  forward-path 
gain)  is  the  logarithmic  amplifier  shown  in  Fig.  II. 1  Recall  that  node  (T) 


K  and  F  are  characterized  by  constants  k  and  1,  respectively.  The  closed- 
loop  system  and  the  characteristics  of  the  nonlinearity  <)>(•)  are  shown  in 
Fig.  11.2  and  Fig.  II. 3,  respectively.  By  theorem  II. 2  (or  theorem  II. 3), 
if  k  becomes  large,  then,  asymptotically,  the  output  y  of  the  closed-loop 
system  will  be  approximately  equal  to  the  reference  signal  r(’)  (since 
F  =  1  in  this  case).  Fig.  II. 4 -Fig.  II. 6  show  the  system  output  y(*), 
the  error  signal  e(*)»and  z(»),  the  input  to  the  nonlinearity  $(*),  in  the 
"steady  state"  for  different  values  of  k  while  the  closed-loop  system  is 
driven  by  r(t)  =  sin  lOt.  The  effect  due  to  high  forward-path  gain  in  a 
feedback  system  is  clearly  illustrated  by  Fig.  II. 4.  Note  that  the  high 
forward-path  gain  distorts  z(*)»  the  input  to  the  nonlinearity  $(•),  so 
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that  asymptotically,  the  output  y(*)  is  approximately  equal  to  sin  lOt . 


Example  II. 2  (Nonlinear,  multi-input,  multi-output,  dynamical  system) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  I . 1 ,  where 
G  is  characterized  by  a  rational  function  matrix 


L(s)  = 


5  x  10 


1  x  10 


(s+1)  (s+103)  (s+10'*)  (s+1)  (s+103)  (s+104) 


5  x  10 


5  x  10 


(s+1) (s+105) (s+104)  (s+1) (s+103) (s+10A) 


followed  by  a  nonlinear  memoryless  C3  map  $(•)  described  by 


(11.25) 


z.  (1  +0.2  tanh  z  )  *v(zi) 

*(  )  - 

_Z2  (1  +  0. 2  tanh  z^) 


(11.26) 


{  sgn  z-  [y  +  ^i^L 


,  if  z  <0.5 


.  if  1*1  >  0.5  , 


(11.27) 


K  and  F  are  represented  by  the  constant  matrices  kl  and  I,  resp.,  both 


in  1R 

The  closed-loop  system,  the  characteristics  of  v(z),  and  the  characteristics 
of  1+0.2  tanh  z  are  shown  in  Fig.  II. 7,  Fig.  11.8,  and  Fig.  II. 9,  respec¬ 
tively.  By  theorem  11.2  (or  theorem  II. 3),  if  k  is  sufficiently  large, 
then,  asymptotically,  the  output  y  of  the  closed-loop  system  will  be 
approximately  equal  to  the  reference  signal  r  (since  F  3  *  I  in  this  case) . 
Fig.  II.10-Fig.  11.13  show  the  system  output  components  y^(*),  y ^ C • )  and 
the  error  signal  components  c^(*),  c^(*),  respectively,  for  different 
values  of  k  e  JK  while  the  closed-loop  system  is  driven  by  the  reference 

signal  r  =  3  =  f  >3n  50t,  .  Fig.  II. 10  and  Fig.  11.11  show  that  as 

r  j  [_0.8  sin  1  >t  J  n 


we  increase  the  compensator  gain  k,  the  system  output  (vector)  function 
approaches  to  the  reference  signal  r  as  if  the  closed-loop  system  was  an 
identity  map  despite  the  complicated  couplings  in  the  nonlinear  plant  G. 

Fig.  11.14  and  11.15  show, for  k  =  40,  a  period  of  the  steady-state  trajec¬ 
tories  of  the  system  outputs,  y(*),  and  of  the  nonlinearity  inputs,  z(*), 
on  the  y-plane  and  z-plane,  respectively.  Note  that  the  greatly  distorted 
trajectory  of  z(*)  (due  to  the  coupling  and  saturation  effects  of  $(•)) 
produces  a  system  output  y(»)  very  close  to  the  reference  signal  r  0.8  sin  15t 


Consider  the  three  large  irregular  lobes  on  the  z(*)  trajectory  in  the 
2nd,  3rd  and  4th  quadrant  of  Fig.  11.15  which  reach  their  peaks  at  time 
instants  t  =  4.54,  4.90,  5.55  respectively.  Observe  that  at  those  time 
instants,  at  least  one  of  the  desired  plant  output  component  (y*  =  sin  lOt, 
y*  =  0.8sinl5t)  reaches  the  peak  of  the  negative  cycle  of  sinusoidal 
waves  (see  Fig.  11.10  and  Fig.  11.11).  Further  observe  that  y^  and  z^, 
y ^  and  z^  are  of  same  sign  for  all  t  since  l+0.2tanhz  >  0  and  \>(z)  is 

an  odd  function.  Now  at  time  t  =  4.54,  the  desired  plant  output  y*(t)  *  .98, 
y^(t)  -  -.70,  thus  v(z^)  (v^))  is  required  to  operate  in  its  positive 
(negative,  resp.)  "saturation"  region.  Due  to  the  negative  value  of  z^> 
l+O^tanhz^  -  0.8.  Consequently,  (1 +0.2  tanh  z^)v(z^)  "saturates" 
earlier  than  v(z^)  itself  and  z^  is  required  to  be  a  large  positive  number 
so  that  y^  =  (1  +0.2  tanh  will  be  approximately  equal  to  the 

desired  value  0.98.  This  explains  the  large  lobe  on  the  trajectory  of 
z(*.)  in  the  4th  quadrant.  Similar  reasoning  explains  the  other  two  large 
lobes  in  the  2nd  and  3rd  quadrant. 
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HI.  ADVANTAGES  AND  LIMITATIONS  OF  FEEDBACK 


Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and 
described  by  eqns.  (I.l)-(1.9)  which  satisfies  the  conditions  stated  in 
theorem  II. 2  (or  theorem  II. 3),  then  asymptotically ,  the  closed-loop 
system  input-output  map  H  is  approximately  F  .  Thus  we  should  expect 
that  the  closed-loop  system  Input-output  map  is  insensitive  to  the  varia¬ 
tions  in  the  forward  path  map  GK  and  that,  if  F  is  linear ,  the  closed-loop 
system  is  close  to  a  linear  system  even  ttiough  the  forward  path  map  GK 
is  highly  nonlinear . 

In  the  following,  we  show  the  advantages  and  limitations  of  feedback 
for  the  nonlinear,  feedback  system  S  shown  in  Fig.  I . 1 :  section  III.l 
calculates  the  exact  effect  of  plant  perturbations  on  the  closed-loop  input- 
output  map  and  demonstrates  the  relations  between  desensitization  and  i) 
the  feedback  structure,  ii)  the  perturbation  on  the  feedback  map  F,  and 
iii)  the  closed-loop  stability;  section  III. 2  establishes  the  exact  effect 
of  various  additive  external  disturbances  on  the  closed-loop  system  output; 
section  III. 3  defines  a  nonlinearity  measure  and  then  shows  precisely 
that  feedback  has  a  linearizing  effect  on  a  nonlinear  plant;  sections 
III. 4  and  III. 5  briefly  review  the  idea  that  feedback  can  achieve  asymp¬ 
totic  tracking  and  disturbance  rejection,  and  stabilize  unstable  systems. 

III.l  DESENSITIZATION 

One  of  the  major  reasons  for  using  feedback  in  design  is  that  feed¬ 
back  can  reduce  the  effect  of  the  plant  perturbations  on  the  input-output 
map.  One  way  to  quantitatively  demonstrate  the  desensitization  effect  of 
feedback  is  to  compare  a  feedback  design  with  a  corresponding  open-loop 


design  [10]:  consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1 

and  described  by  eqns.  ( I .  J.)-(  1 .9)  .  Note  that  the  closed-loop  input-output 

-1 


map  H  :  r 

~yr 


v  is  given  by  GK(I+FGK)  *.  Also  consider  a  comparison  open- 
loop  system  (shown  in  Fig.  III.l)  consisting  of  the  same  plant  G  preceeded 


by  a  compensator  K^.  Thus  the  open-loop  input-output  map  H 
is  given  by  GKg.  Now  if  we  select 
Kq  =  K(I-t-FGK)'1  , 


*v 


'o 


(in.i) 


then  for  all  system  inputs  r,  y  =  y  ,  i.e.  the  (nominal)  open-loop  input- 


output  map  H  :  r  1 — *•  y  is  identical  to  the  (nominal)  closed-loop  input- 
~y0 

output  map  Hyf:  r  *— >  y.  Consider  now  an  arbitrary,  not  necessarily  small , 

perturbation  AG  on  the  plant  G,  then  the  plant  G  becomes  G  :«  G  +  AG;  the 

closed-loop  (open-loop)  system  input-output  map  H  (H  )  becomes 

~yr  ~yQr' 

Hyr  :=  Hyr+AHyr  =  GKU+FGK)'1,^  :=  H^-I-AH  =  GKQ  =  GK(I+FGK)_1, 
resp.).  The  perturbed  closed-loop  (open-loop)  system  is  shown  in  Fig.  III. 2 
(Fig.  III. 3,  respectively). 

Note  that  the  changes  of  the  closed-loop,  and  the  open-loop  system 
input-output  maps  due  to  the  plant  perturbation  AG  are  given  by 


AH  :=  H  -  H  =  GKd+FGK)'1  -GK(I+FGK)_1 
~yr  ~yr  -.y r  _ _  _ _  ...... 


A5y„r  :=  «yor  “  »  =  GKQ  -  CKQ  =  AG-Kq  =  AG-K(I+FGK) 


-1 


'0 


(111. 2) 

(111. 3) 


respectively . 

Theorem  III.l  below  generalizes  some  of  the  results  in  [10,11,12,46] 

and  establishes  the  exact  relation  between  AH  and  AH  ,  and  thus  makes 

-  ~yr  ~y0r 

precise  the  desensitization  effect  of  feedback  for  nonlinear  systems. 
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Theorem  III.l  (Desensitlzatlon  of  plant  perturbation  by  feedback) 


Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and 

described  by  eqns .  (I.l)-(1.9).  Also  consider  the  comparison  open-loop 

system  shown  in  Fig.  III.l.  Let  AH  and  AH  denote  the  changes  of  the 

~yr  ~y0r 

closed-loop,  and  the  open-loop  system  input-output  maps  due  to  the  plant 
perturbation  AG,  respectively.  Assume  that 


(al)  F:  ^  -*•  ^  is  linear; 

(a2)  the  perturbed  plant  G  satisfies  (1.9),  i.e.  (I+FGK)  ^  is  a  well- 

defined  nonlinear,  causal  map  mapping  into  $  ; 

e  ve 

(a3)  GK:  -*•  ^  and  (I+GKF)-1:  ^  ^  are  C1  maps. 


then 


AH  =  f  [I 

~yr  Jn  ~ 


I+D(GK) "Fj'^da-AH  ,  on 

~  ~  ~yor 


(III. 4) 


where  the  Frechet  derivative  [13,  p.  32]  D(GK)  is  evaluated  at 

(I+FGK)  ^(r+aAr)  with  Ar  :=  F*AH  (r),  r  &  R.  ,  and  a  £  [0,1], 

~  ~y0r  e 

Proof  of  Theorem  III.l:  see  Appendix. 

When  the  map  GK  is  linear,  theorem  III.l  reduces  to  the  following 
well-known  result  [10;  11,  p.  24-26;  11  includes  an  extensive  bibliography]. 

Corollary  III. 1.1  (Linear  case) : 

Under  the  conditions  stated  in  theorem  III.l,  if  in  addition,  GK  is 
linear,  then 

AH  =  (I+GKF)_i*AH  ,  on  £  (III. 5) 

~yr  -  ~yQr  ^e 


Proof  of  Corollary  III .1.1:  Follows  directly  from  the  fact  that  D(GK)  =  GK, 
when  GK  Is  linear. 

Remarks  II 1.1: 

(a)  Theorem  II1.1  indicates  that  for  a  class  of  plant  perturbations  AG, 
if  K  and  F  are  chosen  such  that  Vr  £  e  (C  ,  the  class  of  inputs  of 
interest. 


Jo 


( I+D(GK) *F]  1da*AH  (r) |  <<  (AH  (r) 


~yor 


~V 


(III. 6) 


then,  for  such  inputs  r(*),  the  change  of  output  (AH^f(r))  in  the  feedback 
system  S  caused  by  the  plant  perturbation  AG  is  much  smaller  than  the 
corresponding  change  in  the  open-loop  system.  Thus,  with  appropriate 
feedback  design,  the  nonlinear  closed-loop  system  can  be  made  less  vulnerable 
to  the  perturbations  on  the  plant  and  hence  performs  more  closely  to  the 
desired  input-output  map. 

(b)  Equation  (III. 4)  makes  precise  the  concept  (built  upon  linear  cases) 
that  if  one  makes  the  (linearized)  Inverse  return  difference  small,  then 
the  closed-loop  system  is  insensitive  to  the  plant  perturbations .  Note 
that  eqn.  (III. 4)  states  precisely  where  D(GK)  has  to  be  evaluated  and 
along  what  path  the  linearized  inverse  return  difference  map  should  be 
integrated. 

(c)  Differential  sensitivity:  suppose  that  G,  H  ..  are  invertible,  then 

—  -yr 

eqn.  (III. 4)  implies  that,  since  AH  =  AG*G  ^•GK(I+FGK)  \ 


AH 


-yr 


■H-1  =  (  [I 
~yr 


~V 


I+D (GK)  •  F]_1dot*AG *G_1 


(III. 7) 


For  AG,  hence  Ar,  sufficiently  small,  (III. 7)  can  be  approximated  by 


(III. 8) 


AH  *H-1  =  [ I+D(GK) *F ]  1*AG*G  1 

~yr  ~yr  ~  —  ~  ~  ~ 

The  map  [l+D(GK)*F]  ^  is  thus  a  complete  generalization  of  the  classical 
differential  sensitivity  function  (for  linear  time-invariant  case,  see, 
e.g.  [14,15]  for  single-input  single-output  case,  [10]  for  multi-input 
multi-output  case;  for  some  nonlinear  case,  see  e.g.  [11]). 

(d)  Consider  the  special  case  where  G,  K,  F  are  represented  by  some  trans¬ 
fer  function  matrices  G(s),  K(s) ,  F(s),  respectively.  To  achieve  desensi¬ 
tization  with  respect  to  the  given  plant  G(s)  by  feedback,  one  may  design 
K(s)  and  F(s)  so  that  the  maximum  singular  value  of  the  matrix 
l  I+G(ju)K( ju))F(  j(p)  ]  ^  be  much  less  than  1  over  the  frequency  band  of 
interest^  Then,  by  Corollary  111.1,  |  (AH  r)  ( joj)  j  «  |  (AH  r)  (ju>)  j  , 

no  ~yr  ~yor 

for  any  (AH  r) (Jw)  €  C  over  the  frequency  band  of  interest.  Note  that 

~yor 

this  requirement  is  not  equivalent  to  the  following:  "over  the  frequency 
band  of  interest,  |A^(Ji»>)|  >>  1,  Vi,  where  A^(joj)  is  the  i-th  eigenvalue 
of  I  +G(j(i))K(jw)F(jU))"  •  Hence,  in  the  linear,  time- invariant,  multi-input, 
multi-output  case,  plotting  the  eigenvalue  loci  of  I +G(jui)K(jui)F(jw) 
with  u)  as  a  parameter,  although  useful  for  stability  studies  [16,17], 
does  not  have  the  same  desensitization  Interpretation  as  in  the  single- 
input,  single-output  case  (see  e.g.  [14;  15,  Chap.  11]). 


Discussion: 

A.  Desensitization  and  Feedback.  Structure:  Vie  note  that  one  feedback 
structure  is  not  necessarily  superior  to  another  one  in  terms  of  sensitivity 
with  respect  to  the  plant.  We  compare  the  nonlinear,  feedback  system  S 
shown  in  Fig.  1.1  and  described  by  eqns.  (I.l)-(1.9)  with  the  nonlinear, 
multi-loop,  feedback  system  shown  in  Fig.  III. 4  which  consists  of  the 


same  plant  G  and  nonlinear,  causal  operators  K^,  K^,  and  F2. 

Suppose  that  the  (nominal)  closed-loop  system  input-output  maps  of 
these  two  nonlinear,  feedback  systems  are  identical,  i.e. 

GK(I+FCK)-1  =  GK2(I+F2GK2)“iK1lI+F1GK9(I+F2GK2)"1Kir1  (III. 9) 


Now  we  have  the  following  result. 


Proposition  III. 2: 


If  GK,  GK2>  are  1  incar ,  then  eqn.  (III. 9)  becomes 


(I+CKF)_1GK  =  (I-fCK  (F  +Kj_F 


(III. 10) 


Proof  of  Proposition  III. 2:  see  Appendix. 


With  eqn.  (III. 10),  the  relation  of  the  (differential)  sensitivities 
of  the  two  feedback  structures  shown  in  Fig.  1.1  and  Fig.  III. 4  is  made 
clear  in  the  following  remarks. 


Remarks  III. 2; 

(a)  Suppose  that,  in  addition,  the  maps  F,  F^  and  F2  are  also  linear; 
then  (I+GKF)  *  and  [  I+GK^F^+KjF^)  ]  *  are  the  differential  sensitivity 
functions  (see  equn.  (III. 8))  of  the  feedback  systems  shown  in  Fig.  1.1 
and  Fig.  III. 4,  respectively.  Thus  eqn.  (III. 10)  exhibits  a  relation 
between  these  two  differential  sensitivity  functions. 

(b)  In  the  special  case  where  G,  K,  F  are  represented  by  some  scalar 
transfer  functions,  eqn.  (III. 10)  reduces  to 


s)k(s)t(s 


k2(s)k1(s) 


H+g(s)k2(s)  •  (f2(s)+kl(s)f1(s)) f 1  k(s) 


(III. 11) 


Hence,  by  appropriately  designing  k(s),  k^fs),  k2(s),  consistent  with  other 
requirements,  we  can  make  the  feedback  system  shown  in  Fig.  1.1  either  more, 


W 


or  less  sensitive  (to  plant  perturbations,  over  the  frequency  band  of 
interest)  than  the  one  shown  in  Fig.  111.4. 

(c)  For  a  recent  discussion  of  using  local  feedback  to  design  an  audio 
power  amplifier,  see  [42]. 

B .  Desensitization  and  Feedback  Pe r turbat ions 

Proposition  III. 3  below  derives  the  exact  relation  between  the  relative 
change  in  the  closed-loop  system  input-output  map  (due  to  changes  of  the  plant 
G  and  the  feedback  F)  and  the  relative  change  in  the  feedback  F,  thus  makes 
clear  the  tradeoff  between  the  sensitivities  of  the  closed-loop  system  with 
respect  to  the  plant  and  to  the  feedback. 


Proposition  III. 3  (Desensitization  and  feedback  perturbation) 

Consider  the  nonlinear ,  feedback  system  S  shown  in  Fig.  1.1  and  described 
by  eqns.  (I.l)-(1.9),  where  the  plant  G  is  perturbed  and  becomes  G.  Let  the 
feedback  map  F  be  perturbed  and  become  F  :=  F  +  AF.  Let  H  ^  :=  GK(I+FGK)-1 : 

an<*  5yr  :=  =  ^yr  +  ^Hyr‘  weH-deflned  nonlinear, 

causal  maps  (thus  AH  includes  the  effect  of  p] ant  and  feedback  perturbations). 
Suppose  that 


(al)  F:  Ye  linear; 

(.2)  r^.  *i  are  well-defined,  causal  maps; 

(a3)  GK  and  (I+FGK)-1  are  C1  maps. 


Then 


-1 

{«  [l+D(GK)T]_1da-l}*F"l-AF, 

-'0  -  ~  “  " 


(III. 12) 


where  the  Frechct  derivative  D(CK)  is  evaluated  at  (T+FGK)'1 (r+aAr)  with 
Ar  -AF*Hyrr,  r  €  and  a  €  [0,1]. 


_  , 


* 


Prool  of  Proposition  111.  V.  see  Appendix. 


Remar ks  III .  3 : 

(a)  Note  that  if  we  choose  to  desensitize  the  closed-loop  system  with  respect 
to  the  plant  G  by  making  the  inverse  linearized  return  difference  [I+D(GK)’F]  * 
"small"  over  some  neighborhood  of  $  ,  the  class  of  inputs  of  interest,  as  is 

suggested  by  eqn.  (III. 4),  then  f  [I+D(GK)*F]  *dot-I  -  -I  and  by  eqn.  (III. 12), 


AH  *H  1  =  -F-1*AF  on  U.  :=  H  £  ,  . 

-yr  ~yr  ~  ~  <fd,e  -yr^d.e 


Thus,  the  relative  change  in  H^r 


is  approximately  equal  to  the  relative  change  in  the  feedback  F;  consequently , 
the  closed-loop  system  is  insensitive  to  the  plant  perturbations  but  sensitive 
to  the  feedback  perturbations. 

(b)  In  the  special  case  where  G,  K,  F  are  represented  by  some  scalar  transfer 

functions,  eqn.  (III. 12)  reduces  to  the  classical  result:  over  the  frequency 

Ah  /h 

band  of  interest,  if  |l+g( jw)k(jo))f (jo))  |  »  1,  then  — -  -1. 

(c)  It  is  often  advantageous  to  trade  the  insensitivity  with  respect  to  the 
feedback  map  F  for  the  insensitivity  with  respect  to  the  plant  G,  since  the 
feedback  F  is  usually  operated  at  a  low  power  level  and  hence  can  be  built 
with  inexpensive,  high  quality  components. 


C.  Desensitization  and  Instability 

It  is  well-known  (see  e.g.  [14,  p.  141-143])  that,  for  most  linear, 

time-invariant,  single-input,  single-output  feedback  systems,  the  closed-loop 

system  stability  requirement  imposes  an  upper  bound  on  the  system  loop  gain,  thus 

the  stability  requirement  limits  the  achievable  densitization  of  feedback. 

We  show  below  that  such  a  constraint  still  holds  for  a  large  class  of  linear, 

t ime- invariant ,  tnul ti-lnput  multi-output  systems. 

Consider  the  feedback  system  S  shown  in  Fig.  1,1  where  K,  G  and  F  are  represented 
n^xn^  n  xn  n  xn 

by  kM  6  R  ,  C(s)  £  JR(s)  ,  1R  £  1R  0  °,  respectively  where  k  £  ]R+ .  To 

o 
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achieve  desensitization  with  respect  to  the  given  plant  C(s)  by  feedback,  we  may 
choose  k  £  IR+  as  large  as  possible  so  that  the  maximum  singular  value  of  the 
matrix  [I+kG(ju))M|  ^  be  much  less  than  I  over  the  frequency  band  of 
interest.  However,  stability  considerations  often  impose  an  upper  bound  on 
the  allowable  k's.  More  precisely,  we  have  the  following  proposition. 

Proposition  III. A  (Desensltlzatlon  and  instability) 

Consider  the  feedback  system  S  shown  in  Fig.  1.1,  where  K,  G,  F  are 
n.xn  n  *n  n  *n 

represented  by  kM  £  IK  ,  G(s)  £  JR(s)  °  ,  I  £  H  °  °,  respectively,  with 

k  >  0,  and  si — ♦dot[I+k  C(s)M|  /  constant  .  Assume  that Vi  =  1,2,  ...,n  , 

•  o 

and  Vj  =  1,2, ... ,n  , 

^[d1;J(s)]  -  3[nij(s)]  >  3  (III.  14) 

nii  th  n  xn- 

where  -j— is  the  (i,j)  element  of  G(s)  £lR(s)  °  J  and  3[p(s)]  denotes  the 

ij 

degree  of  the  polynomial  p(s).  Then,  for  k  £  li  sufficiently  large, 

O 

det[I+kG(s) 'M]  has  C+-zeros  with  real  parts  which  tends  to  +<*>  as  k  -*■  “>. 

Proof  of  Proposition  III. A:  see  Appendix. 

Remarks  III, 4 : 

(a)  Since  det [l+kC(s)M]  is  equal  to  the  ratio  of  the  closed- loop  sytsem 
characteristic  polynomial  to  the  open-loop  system  characteristic  polynomial 
(see  e.g.  [18]),  Proposition  III. A  states  a  condition  under  which  the  closed- 
loop  system  becomes  unstable  for  k  sufficiently  large. 

(b)  When  =  n0  =  1*  single-input  single-output  case.  Proposition  III. A 

reduces  to  the  classical  result  which  can  be  easily  proved  by,  e.g.,  the  root 
locus  method  (see  e.g.  [14,  p.  141-143]). 


III. 2  DISTURBANCE  ATTENUATION 


All  physical  systems  operate  jn  some  environment  where  they  are  subjected 
to  some  "uncontrollable"  disturbances.  If  we  knew  exactly  these  disturbances, 
then  we  could  program  (in  advance)  the  system  inputs  such  that  the  effect  of 
these  disturbances  be  cancelled  out.  However,  in  most  real  systems,  there 
is  either  no  complete  knowledge  of  such  disturbances  (temperature,  wind, 
wear,  load  changes,  etc.)  or  the  cost  of  measuring  them  and  compensating 
for  them  is  prohibitive;  hence  such  "open-loop"  design  based  on  cancellation 
is  not  practical  and  we  have  to  resort  to  feedback.  The  analysis  below  shows 
exactly  what  feedback  can  achieve  for  disturbances  attenuation. 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and  described 
by  eqns.  (I.l)-(1.9)  but  subjected  to  some  additive  external  disturbances 
as  shown  in  Fig.  III. 5  where 

d^(‘)  is  the  system-input  disturbance, 
d  (•)  is  the  plant- input  d isturbance, 
do(‘)  is  the  system-output  disturbance, 
d ^ ( • )  is  the  feedback-path  disturbance. 

It  is  intuitively  clear  that,  in  general,  an  error-driven  feedback 
system  such  as  the  one  shown  in  Fig.  III. 5  cannot  attenuate  the  input  dis¬ 
turbances  d^(*)  and  the  feedback-path  disturbance  d^(*),  since  such  feedback 
systems  cannot  distinguish  the  system-input  disturbance  d^(*)  from  the  system  input 
r(‘)  and  the  feedback  path  disturbance  dj.(*)  from  the  system  output  y(*).  Indeed, 
as  seen  from  Fig.  III. 5,  the  error  signal  e(*)  is  affected  by  the  corrupting 
signals  d^  and  d^.;  hence  c ( • )  cannot  drive  the  plant  as  desired  (in  some  cases, 
judicious  filtering  may  alleviate  such  problems).  Nevertheless,  we  expect  that 
feedback  can  reduce  the  effect  of  plant-input  and  system-output  disturbances 


on  the  system  output;  indeed  such  effects  could  be  modeled  by  some  appropriate 

plant  perturbations,  and  their  effect  on  the  system  output  has  been  shown, 

in  sec.  III.l,  to  be  reducible  by  feedback. 

The  propositions  below  evaluate  exactly  the  effects  of  the  disturbances 

d^,  dQ,  d^,  d^  on  the  system  output  y(’)-  Note  that  unlike  the  linear  case, 

the  effect  of  the  disturbance  d^  (a  =  i,o,f,g)  on  the  system  output  y(*)  is 

not  given  by  H  ,  (d  ) ,  where  H  .  :  d  y  is  calculated  when  r  and  all  the 

-  ~yd  a  -yd  a  7 

J  a  7  a 

other  disturbances  are  set  to  zero. 

Proposition  III. 5  (System-output  disturbance,  feedback-path  disturbance 
and  feedback) 

Consider  the  nonlinear,  feedback  system  shown  in  Fig.  III. 5  and  described 
by  eqns.  (1.1)— (1.9) .  Let  Gu  :=  Gu+d^  and  Fy  :=  F(y+d^) .  Suppose  that 

(al)  F:  ^  -*•  ^  is  linear ; 

(a2)  GK  and  (I+FGK)"1  are  C1  maps. 

U.t.c. 

(i)  if  d  ^  0  and  d.  =  d  =  d,  =  0,  then  Vr  G  &  , 

o  i  g  f  ’  W*’ 

Ay  :=  GK(I+FGK)_1(r)  -  GK(l+FGK)_1(r) 

-  l  [ I+D(GK) • F]_1da*d  (III. 15) 

~  ~  o 

where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)_1(r+aAr)  with 
Ar  =  F*d  and  a  G  [0,1]. 

(ii)  if  d  ^  0,  d  /  0  and  d.  =  d  =0,  then  Vr  G  $ 

or  i  g  e 

Ay  :=  GK(I+FGK)_1(r)  -  GK(I+FGK)_1(r) 

-  (I  [l+D(GK),F]”1da-  l}'dr  (III. 16) 

where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)"1 (r-KxAr)  with 
Ar  -  -F*d„  and  a  G  (0,1]. 


Proof  of  Proposition  III. 5;  see  Appendix. 


Proposition  ill. 6:  (Plant- input  disturbance  and  feedback) 


Consider  the  nonlinear,  feedback  system  shown  in  Fig.  III. 5  and  described 
by  eqns.  (I. 1)— (1.9) ,  where  d^  =  d^  =  d^  =  0.  Let  Gu  :=  G(u+d^) .  Suppose 


is  linear; 


(a2)  GK,  (1+FGK)- 1  are  CL  maps. 


Then,  Vr  E  (ft 


Ay  :=  GK(I+FGK)_1(t  )  -  GK(I+FGK)_1(r) 

-  {\  [I+D(GK)*F]_1da}* [I  DG(u+fld  )d6]*d 

J0  ~  ~~  ~  Jo  ~  8  * 


(III. 17) 


where  the  Frechet  derivative  D(CK)  is  evaluated  at  (I+FGK)  ^(r+aAr)  with 
Ar  =  F[G (u+d  )-G(u)],  u  :=  K(I+FGK)_1r,  and  a  G  [0,1]. 

"w  ^  O 


Proof  of  Proposition  III. 6:  see  Appendix. 


Proposition  III. 7:  (System-Input  disturbance  and  feedback) 

Consider  the  nonlinear,  feedback  system  shown  in  Fig.  III. 5  and 
described  by  eqns.  (I.l)-(1.9),  where  d^  =  d^  *  d^  ■  0.  Suppose  that  F,  GK 
and  (I+FGK)  ^  are  C^  maps,  then  Vr  £  ^  , 


Ay  :=  GK ( I+FGK) _1(r+d  )  -  GK( I+FGK)-  tr) 
-  —  1  '  ~ 

=  l  D(GK) [I+DF* D(GK) ]  da*d 

Jo .  1 


(III. 18) 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r+ad^)  and  DF 
is  evaluated  at  GK[i+FGK]  ^(r+otd^)  with  a  E  [0,1]. 

Proof  of  Proposition  III. 7;  Follows  directly  from  Taylor’s  expansion  theorem 
[19,  p.  190]. 
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Comments  on  Propositions  IIT.5-III.7 : 

(a)  Eqns.  (III.15)-(III. 18)  show  exactly  how  feedback  can  reduce  the  effects 

of  various  external  disturbances  on  the  system  output.  Note  that,  by  eqns. 

(III. 15)  and  (III. 16),  simultaneous  disturbance  attenuation  of  d  and  d,  is, 

o  f 

in  general,  impossible. 

(b)  In  the  special  case  that  G,  K  and  F  are  linear,  the  effects  of  the  dis¬ 
turbances  dQ,  d^,  d^,  d_^  on  the  system  output  reduce  to  (I+GKF)  ^dQ , 

[(I+GKF)  ^-I]d  ,  (I+GKF)  ^Gd  and  CK(I+FGK)  ^d  ,  respectively.  Note  that  in 

~  -  t  ~  ~ —  -  g  —  ~  — •  i 

this  case,  those  disturbance-output  maps  are  related  by,  with  obvious 
notation 


H,  =  I  +  H  .  =  I-H  ,  KF=  I-ll  ,  F 
~yd  ~  -yd  ,  ~  ~yd  —  -  -yd . - 

o  f  y  g  •  t 


III. 3  LINEARIZING  EFFECT  [20] 


(III. 19) 


It  is  often  required  that  the  map  from  the  system  input  to  the  system 
output  is  as  linear  as  possible,  e.g.  HiFi  amplifiers,  telephone  repeaters, 
measuring  instruments,  pen  recorders,  etc.  How  to  design  such  a  system  which 
uses  some  inherently  nonlinear  plant  is  an  important  problem.  From  the 
discussion  in  section  II,  we  know  that  if  the  feedback  map  F  is  linear  and 
if  the  inverse  loop  gain  is  small,  then  the  closed-loop  system  input-output 
map  will  be  close  to  a  linear  map.  Thus  we  expect  that  feedback  has  a 
linearizing  effect  on  an  otherwise  nonlinear  system.  To  make  this  idea 
precise,  we  first  introduce  the  concept  of  nonlinearity  measure. 

A  Nonlinearity  Measure 

Let  be  an  extended  normed  (input)  space.  Let  ^  be  an  extended 
semi-normed  (ouLput)  space.  Let.  ^  *  [N:  %  •>  V  ,  N  is  causal,  nonlinear). 


II 


j 


Let  x  ~  (L:  causal,  linear}.  Now  consider  N  £  ^  and  Y  C  , 

a  set  of  inputs  of  interest.  Intuitively,  the  degree  of  nonlinearity  of  N, 
when  N  is  driven  by  u  £  V,  may  bo  measured  by  the  error  |Nu  -  Lu|  for  u  £  Y , 
where  L  £X  is  a  "best"  linear  approximation  of  N  over  V.  More  precisely, 
we  introduce  the  following  derinltion. 

Definition  III. 8  (Non linea r itv  measu re) 

bet  N  £  ^L,  ‘h  C  ^  and  T  £  ^T.  The  nonlinearity  measure  of  N  over  *lf 
with  respect  to  T  is  the  non-negative  real,  number  defined  by 

6  (N,W  :=  inf  sup  |Nu-Lu|  .  (III. 20) 

L ££  ~  ~  1 

Remarks  III. 8: 

(a)  L  £<A  is  thus  said  to  be  a  best  linear  approximation  of  N  over  V  iff  L 

is  a  minimi  zer  of  (ITT.  20),  i.e.,  tS,  (N,V)  =  sup  |Nu  -  L*u  |  . 

1  *  »£r  '  '  T 

(b)  In  the  case  where  is  a  seminornied  space,  we  then  have  the  nonlinearity 

measure  of  N  over*?/  with  respect  to  sup2T  (typically,  sup  ^  =  <»)  arid  eqn.  (III.  20) 

becomes  <$(N  ,1f)  =  inf  sup  |  Nu-Lu  |  . 

lJEaf  uEV  ~  ~ 

(c)  The  well-known  describing  function  (see  e.g.  [21,22])  is  the  best  linear 
approximation  of  a  nonlinear  operator  with  respect  to  our  nonlinearity  measure 
(III. 20)  provided  that  'V ,  the  class  of  inputs,  is  suitably  defined.  Recall 

that  the  criterion  which  the  describing  function  method  uses  to  find  a  best  linear 

approximation  L  of  a  nonlinear  system  N  i s  to  minimize  the  mean  square  error 

if1  2 

lim  —  1  [ (Nu) (t)-(Lu) (t) ]  dt  over  a  class  of  inputs  u(*)  (usually 

T-*°°  T  Jo 

u(t)  =  asinoit,  a  >  0,  w  >  0,  and  thus  L  depends  on  the  parameters  a,  ui)  .  To 
see  the  relation  between  the  describing  function  and  our  nonlinearity  measure, 
let  a  >  0,  u)  >  0  be  given,  let  Y  be  the  s ingl  eton  {a  sin  u)t }  and 
^  =  (y(*):  1R+  +IR  |  y  ( • )  is  asymptotically  -^—periodic'  '}  be  equipped  with 
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/• 


j  r 1  2  L  /  2 

the  semi-norm  |y|  :=  [ 3  im  —  I  |y(t)|  dt  |  ,  then  a  best  linear  approximat ion 

T-*°°  J  o 

to  the  nonlinear  system  N  according  to  our  definition  III. 8  is  a  minimizer 

if-  2 

of  lim  —  l  [ (Nu) ( t)- (Lu) ( t) ]  dt  which  is  precisely  the  describing  function 
T-«o  J  o 

of  N  with  respect  to  the  inputs  u(t)  =  asinwt.  Note  that  in  this  case, 
the  minimizer  of  (III. 20)  (i.e.  the  describing  function  of  N  with  respect  to 
u(*))  is  parametrized  by  a  and  u). 

(d)  With  the  framework  of  extended  spaces,  we  can  discuss  the  nonlinearity 
measure  of  a  nonlinear  system  over  a  bounded  time  interval,  say,  [0,T]. 

Note  that  a  nonlinear  system  N  may  have  its  nonlinearity  measure  S^N.'Z')  =  0, 
VT  _<  T*  6  O ,  but  6^(N,'2/0  £  0  for  T  >  T* ,  simply  because  N  is  operating 
within  the  linear  range  of  its  charact eristics  before  time  T* . 

(e)  At  the  cost  of  some  complication,  the  class  of  nonlinear  operators 
under  consideration  can  be  extended  to  include  the  nonlinear  dynamical 
relations. 

(f)  Other  nonlinearity  measures  may  be  defined,  e.g.,  we  can  define 

|Nu-Lu|T 

{t(N,Y)  =  inf  sup  — i — \ - .  Note  that  such  nonlinearity  measure  does 

T  -  l e*  uev  ' u't 

uT/o 

satisfy  all  t3ie  remarks  mentioned  above  and  all  the  properties  stated  below. 
However,  we  have  not  been  able  to  obtain  results  similar  to  the  Theorem  III. 14 
below. 

Properties  of  the  Nonlinearity  Measure  6^ ( N ,1f) 

Proposition  II I . 9 : 

lf  ?2  =  +  for  some  LJ1  €  then  =  <5t(N2,‘?0,  VT  GO", 

VtfC  U  . 

e 

Proposition  I I 1.10: 

If  Vj  C  V2  C  U,  then  6t(N,^1)  <  ^(N,^),  VT  eX. 


Proposition  ITT.  l_l : 

Suppose  that  VT  £  ^  p^fy,  is  a  normed  space. and  that  NO  =  0.  U.t.c.  if 
N  is  Frechet  differentiable*'^  at  0,  then  VT  £  ^7, 

0  _<  6  (N , B  (0 ; 3) )  <  sup  |Nu-DN(0)*uj  -*•  0,  as  &  -*■  0  (III. 21) 

UGBt(0;S)  ~  "  T 

where  B_ ( 0 ; B)  :  =  (u  £  U.  I  I  ti  |  _  <  [i]  and  DN(0)  denotes  the  Frechet  derivative  of 
T  e 1  T  — 

N  at  0. 

Proposition  III. 12: 

Let  V  C  ti  be  the  sot  of  inputs  of  interest.  If  for  some  L  £  <A  , 
e  ~ 

Nu  =  Lu,  Vu  £  V,  tiien  i^CN,!/)  =  0,  VT  £  In  particular,  if  N  £ 

then  6  (N,V)  =  0,  VT  £  Vt CC 

Proposition  III. 13: 

Let  be  the  set  of  inputs  of  interest.  Let  £.  be  specialized  into 

the  class  of  continuous ,  ^  *(l)  linear,  causal  operators  mapping  'l l  into 
Suppose  that 

(al)  VT  £  CT,  is  a  Banach  space; 

(a2)  VT  £  CF,  VCli  is  bounded,  i.g.  sup  |u|  < 

6  u£V  T 

(a3)  VT  £  ST,  3ft  >  0  such  that  VD  ^(OjB)  :=  (u€Ke|  |u|T£P}. 

U.t.c.  if  for  some  T  GO",  ^.(N.lr)  =  0,  then,  "^L*  £  <£.  such  that 

|Nu-L*u|t  =  0,  Vu  £  V .  (III. 22) 

Proofs  of  Propositions  I  IT. .  9-  1  I  1. 13:  see  Appendix. 

Comments  on  Propositions  II  9- ITT  .  1  3: 

(a)  Proposition  III. 9  stales  the  obvious  fact  that  if  two  nonlinear,  causal 
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operators  differ  by  a  linear  causal  operator,  then  they  roust  have  the  same 
nonlinearity  measure.  It  is  also  intuitively  clear,  from  a  perturbat ional 
viewpoint,  that  if  a  linear,  causal  operator  is  subject  to  some  nonlinear 
causal  perturbation,  then  the  nonlinearity  measure  of  the  perturbed  nonlinear, 
causal  operator  must  be  the  same  as  that  of  the  nonlinear  perturbation. 

(b)  Proposition  III. 10  emphasizes  the  fact  that  the  nonlinearity  measure 
depends  on  the  class  of  inputs  we  are  considering:  the  larger  the  class  of 
inputs  we  consider,  the  greater  the  nonlinearity  measure  of  operator  N. 

(c)  Proposition  III. 11  is. another  way  of  stating  the  well-known  fact  that 
(since  NO  =  0)  the  best  local  linear  approximation  of  a  Frechet  differentiable 
nonlinear  operator  N  at  the  operating  point  0  is  the  Frechet  derivative  of  N 
at  0.  Note  that  by  e<|n.  (111.21),  fi,(,(Ntll  (0;|5))  -+  0  as  (j  *•  0,  i.e.  N  behaves 
locally  like  a  linear  operator  as  we  expected. 

(d)  Proposition  111.12  states  that  (N,Vj  satisfies  the  natural  requirement 
for  a  nonlinearity  measure,  namely,  if  N  behaves  as  a  linear  causal  operator 
over  the  class  of  inputs'^  in  the  time  interval  [0,T]  C  3',  then  {^(N.IO  =  0. 

(e)  With  some  mild  technical  assumptions,  proposition  111.13  establishes 

the  following  desirable  property  of  6^ ( N :  if  =  0,  then  N 

behaves  like  a  linear ,  causal  operator  over  V  in  the  time  interval  [0,T]  C 
Note  that  if  =  0,  then  6  ,  (N.'fr')  =  0,  VT  ’  <  T. 

Linearizing  Effect  of  Feedback 

With  the  nonlinearity  measure  defined  in  eqn.  (III. 20),  we  now  can  make 
precise  the  idea  that  feedback  has  a  linearizing  effect  on  an  otherwise 
nonlinear  system. 

Note  that  the  nonlinearity  measure  defined  in  (Til. 20)  allows  us  to  compare 
nonlinear  systems  by  their  degree  of  nonlinearity.  However,  a  meaningful 


MiMw'Tli  \  ‘ 


■■■ . 


comparison  requires  careful,  choice  of  the  sets  of  inputs  since  the  nonlinear¬ 
ity  measure  depends  on  the  set  of  inputs  we  are  considering.  From  an  engi¬ 
neering  point  of  view,  we  are  interested  in  comparing  systems  which  produce 
desired  outputs  (e.g.,  signals  within  certain  frequency  band  or  dynamical 
range).  Hence  in  the  following  discussion  of  the  linearizing  effect  of 
feedback,  we  shall  compare  the  nonlinearity  of  measure  of  a  nonlinear  plant 
and  of  a  feedback  system  which  includes  such  a  plant;  we  shall  choose  a  set 
of  Inputs  for  each  system  so  that  both  systems  produce  the  same  set  of 
desired  outputs. 

Consider  the  nonlinear  feedback  system  S  shown  in  Fig.  1.1  and  described 
by  eqns.  (I.l)-(1.9),  except  now  that 


% 


is  an  extended  sem inormed  space 


Let  ^  be  the  set  of  desired  outputs.  Let  ^  e  ^ 

be  the  set  of  system-inputs  r(*)  such  that  H  OL ,  = 

-yr  d,e  /d,e 

Let  ^  C  be  the  set  of  plant-inputs  u(')  such  that 

Oil,  =  Vi  • 

~  d,e  ‘'a.e 


/ (III  .24) 


Now  we  have  the  following  theorem: 


Theorem  III. 14  (Linearizing  effect  of  feedback) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and  described 
by  eqns.  (I - 1)-(I . 9)  and  (III . 23)-(TII . 24) .  For  some  T  6  X  let  L*  €  i 
be  a  best  linear  approximation  to  G,  i.e. 

MG.Ii,  )  -  sup  j Cu-I.*u |  (III. 25) 

d,e 

Assume  that  F:  V  -*■  £  and  are  linear ,  causal  and  that  the  linear 

* 

map  (I+L  KF)  has  a  causal  Inverse,  then 
%  * 


CKU+FCK) 


Proof  of  Theorem  HI.  14:  see  Appoint  ix 


Remarks  III. 14 


In  a  design  problem,  given  some  G  G  ??  together  with  its  best  linear 


approximation  i. 


with  respect  to  some  T  €  y,  if  one  designs  K,  F 


over 


consistent  with  other  requirements,  then 


consideration  and  for  the  time  interval  of  interest,  the  closed-loop  system 


is  much  closer  to  a  linear  system  than  G  itself.  This  result  clearly 


exhibits  the  linearizing  effect  of  feedback 


Note  that  p  is  defined  via  the  inverse  linearized  return  difference 


operator  (I+L^KF)  (when  we  break  the  Loop  after  the  plant  G)  :  since 
the  nonlinear  plant  G  can  be  thought  as  a  linear  plant  L*  being  subject  to 


some  nonlinear  perturbation  G-L 


md  we  know  that  (see  eqn .  (III.8)or  [43])  ns  a 


first  order  approximation,  the  effect  of  a  non! inear  perturbation  on  the  otherwise 


linear  closed-loop  system  is  reduced  by  the  factor  (I+I,  KF)  by  feedback 


K,  F  are  Linear  and  time-invariant ,  thus  represented  by  transfer 


function  matrices  l  *(Jw),  K(ju)),  F(  jf>>) ,  respectively) ,  then  p  <<  1  if  the 


maximum  singular  value  o 


is  small  over  the  frequencies 


Example  III.l  (Single-input  single-output  memory  less  system) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1,  where  G  is 

characterized  by  the  piecewise- 1  inear  function  shown  in  Fig.  III. 6,  K  and  F 

are  represetned  by  constant  gains  10  and  1,  respectively.  It  is  easy  to 

show  that  the  closed-loop  input  -output  map  H  is  characterized  by  the 

piecewise-linear  function  shown  in  Fig.  Ill, 7.  Now  let  us  consider  the  case 

where  e  =  (y(*):  1R+  VIK  j  (v  0 . 8  f ,  then  the  corresponding  g  =  {u(«): 

1R+ '•'IR |  I u 1  •  2 }  and  ^  =  (r:  F+->Ir|  |  r  |ro_<  0. 92} .  A  straightforward  minmax 

calculation  shows  that  the  best  linear  approximation  L*  of  G  is  a  constant 

gain  of  0.6  and  the  nonlinearity  measure  of  G  is  iS_(G,^.  )  »  0.12,  VT  £  T ; 

~  T  ~  d ,  e 

more  precisely,  6  (G,fA  )  =  sup  |Gu-0.6u|  =  0.12.  Similarly, 

,C  A^f4l,e  ~0  1? 

<5.r(H  ,/?,  )  =  sup  |H  r  -  "r  |  ’  *>  — 1 ,  VT  G  S'.  Thus  the  nonlinearity 

i  —  yr  u ,  e  *  • 

measure  of  G  has  bedn  reduced  by  7  by  feedback.  Note  that  p  ■ 

-  1  +  0 .  o*10  7 

i.e.  for  this  example,  the  equality  holds  in  eqn.  (III. 26).  The  best  linear 
approximations  of  G  and  H  are  shown,  by  the  broken  lines,  in  Fig.  III. 6 
and  Fig.  III.  7,  respectively.  To  further  illustrate  the  linearizing  effect 
of  feedback,  we  drive  the  nonlinear  plant  G  with  u  =  l,2sinu>t  and  the  closed- 
loop  system  GK(I+FGK)  ^  with  r  =  0.92sinu)t.  The  corresponding  (open-loop 
system)  output  y^  and  the  (closed-loop)  output  y  are  shown  in  Fig.  III. 8. 

In  general,  it  is  quite  difficult  to  calculate  the  nonlinearity  measure 
<5t  of  a  nonlinear  dynamic.-!  1  system  and  to  obtain  the  best  linear  approximation 
of  such  a  system.  Howevpr,  for  a  given  nonlinear  plant  G,  we  may  illustrate 
the  linearizing  effect  of  feedback  by  computing  the  closed-loop  system  output 
with  respect  .to  several  different  compensator  gains  while  the  closed-loop 
system  Is  driven  by  some  test  signals.  Examples  11. 1  and  II. 2  in  section  II 
clearly  exhibit  the  linearizing  effect  of  feedback  on  nonlinear  dynamical 


systems.  Note  that  the  higher  the  compensator  gain  is,  the  more  linear  the 


-37- 


/ 

closed-loop  system  appears  to  be  as  we  expected  from  the  result  of  theorem 
III. 14  (since  p  defined  in  eqn.  (111.27)  decreases  as  the  gain  of  K  increases). 

III. 4  ASYMPTOTIC  TRACKING  AND  DISTURBANCE  REJECTION 

One  important  application  of  feedback  in  control  is  the  servomechanism 
design  which  aims  at  asymptotic  tracking  and  asymptotic  disturbance  rejection. 
Let  us  consider  the  asymptotic  tracking  problem.  From  the  discussion  of 
generalized  Black's  formula  in  sec.  II,  we  know  that  if  we  let  F- =  I  in  the 
nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and  if  we  make  the  "forward-path 
gain"  sufficiently  large,  then,  asymptotically,  the  output  y(«)  will  be 
approximately  equal  to  the  system  input  r(*).  Thus  we  might  intuitively 
guess  that  we  can  obtain  jperjtect  asymptotic  tracking,  i.e.  zero  steady  state 
error,  by  requiring  the  "forward-path  gain"  be  infinite  a_t  the  frequency  of 
the  system  inputs .  This  turns  out  to  he  correct.  Indeed  in  the  classical 
servomechanism  design  [23],  an  integrator  is  required  in  the  compensator  in 
order  that  the  system  output  track  step  signals  with  zero  steady-state  error. 
For  multi-input ,  multi-output  systems,  such  a  design  principle  has  also  been 
proven  to  be  correct  for  linear  (see  e.g.  [24,25,26])  as  well  as  nonlinear 
cases  (see  e.g.  [27]). 

'III. 5  STABILIZATION 

Stability  is  a  primary  concern  of  engineers  since  an  unstable  system 
is  obviously  useless.  However,  there  are  many  inherently  unstable  systems 
such  as  rocket  booster  systems,  nuclear  reactors,  some  chemical  reactors, 
etc.  which  are  useful  in  practice  and  hence  must  be  stabilized.  Note  that 
any  open-loop  stabilization  scheme  fr;  doomed  to  failure  in  practice  because 
it  is  based  on  some  kind  of  cancel lat Jon  which  will  eventually  fail  ns  a 


result  of  changes  in  element  characteristics,  effects  of  environment,  etc. 


Hence  feedback  seems  to  be  the  only  way  out. 

Many  researchers  have  studied  the  use  of  feedback  in  stabilizing  unstable 
systems.  For  lumped,  linear,  time-invariant  systems,  it  has  been  shown  that 
a  constant  state  feedback  (see  e.g.  [28,29])  or  a  dynamical  output  feedback 
(see  e.g.  [30])  can  stabilize  an  unstable  system;  recently,  Youla  et.  al. 

[31]  gave  a  characterization  of  all  stabilizing  feedback  controllers.  For 
lumped,  linear,  time-varying  systems,  a  time-varying  state  feedback  can  be  obtained 
(see  e.g.  [32,38,39,40,41])  to  stabilize  an  unstable  system.  For  distributed, 

linear,  time- invariant  systems,  state  feedback  can  also  stabilize  unstable 
systems  (see  e.g.  [33;34,  chap.  14]).  In  contrast  to  linear  cases,  little 
is  known  about  the  nonlinear  case  except  for  some  limiting  cases.  It 
should  also  be  pointed  out  that  little  is  known  about  how  to  proceed  with 
the  design  of  a,  say,  state  feedback,  stabilization  scheme  so  that  the 
resulting  closed-loop  system  stability  is  very  robust  with  respect  to  changes 
in  the  plant  and/or  the  feedback  map.  In  this  aspect,  for  the  linear  time- 
invariant  case,  singular  value  analysis  has  provided  some  valuable  Informa¬ 
tion  (see  e.g.  [44]) . 

IV.  CONCLUSION 

This  paper  has  treated  the  fundamental  properties  of  feedback  for 
nonlinear,  time-varying,  multi-input,  multi-output,  distributed  systems.  We 
observed  that  the  classical  Black  formula  does  not  depend  on  the  linearity 
nor  the  t ime- Invariance  assumptions;  we  used  the  input-output  description 
of  nonlinear  systems  to  actually  generalize  Black's  formula  to  the  nonlinear 
case  (Theorems  II. 1  to  11.3).  Our  analysis  then  established  achievable 
advantages  of  feedback,  f.-nnilLar  to  feedback  engineers,  for  nonlinear  systems 
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(section  III):  theorem  III.l  showi-il  the  exact  relation  between  tlie  changes 
in  the  open-loop  and  closed- loop  input-output  maps  caused  by  nonlinear,  not 
necessarily  sroal 1 ,  plant  perturbations;  propositions  111,5-111.6  calculated 
the  exac t  effect  of  various  additive  external  disturbances  on  the  output  of 
a  nonlinear  system;  theorem  111.14  related  the  nonl inear ity  measure  of  a 
nonlinear  plant  and  that  of  a  feedback  system  including  such  a  plant; 
sections  III. 4  and  III. 5  briefly  reviewed  the  use  of  feedback  to  achieve 
asymptotic  tracking  and  disturbance  rejection,  and  to  stabilize  unstable 
plants,  while  references  are  given  for  more  detailed  discussion.  These 
results  showed  precisely  how  to  achieve  desensitization,  disturbance  attenua¬ 
tion,  linearizing,  asymptotic  tracking  and  disturbance  rejection  by  feedback 
in  nonlinear  systems. 

The  benefits  of  feedback  do  not  come  without  limitations  or  tradeoffs 
as  propositions  III.2-III.5  showed:  proposition  III. 2  showed  the  relation 
between  desensitization  and  feedback  structure;  proposition  III. 3  showed  the 
tradeoff  between  the  sensitivities  of  a  nonlinear,  feedback  system  with 
respect  to  the  perturbations  on  tiie  plant  and  on  the  feedback  map;  proposi¬ 
tion  III. 4  showed  that  stability  requirements  restrict  the  achievable  desen¬ 
sitization  effect  by  feedback;  proposition  III. 5  showed  the  tradeoff  between 
the  output  disturbance  attenuation  and  the  feedback-path  disturbance  attenua¬ 
tion.  Note  that,  due  to  the  lack  of  appropriate  language  and  tools,  we  did 
not  discuss  the  tradeoff  between  the  gain  and  bandwidth.  Consequently,  we 
did  not  explore  the  limitations  on  the  benefits  achievable  by  feedback 
imposed  by  the  plant  with  fixed  gain  anti  and  bandwidth  (in  the  context  of 
the  Bode  design  method  [45],  the  gain-bandwidth  of  a  given  active  device 
imposes  an  upper  bound  on  the  return  difference  over  a  specified  bandwidth). 


Also  note  that  we  have  only  treated  deterministic  systems,  i.e.  no  stochas 


tic  models  were  introduced  for  noise,  perturbations,  element  variations 


etc.  Thus,  in  particular,  me  did  not  mention  the  well-known  limitation  on 


compensator  gain  caused  by  noise 


In  clarifying  the  features  of  nonl iuear  systems  that  are  required  for 


feedback  to  be  advantageous,  this  paper  will  help  engineers  obtain  better 


understanding  of  nonlinear,  feedback  systems 
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APPENDIX 


I 

. 


Proof  of  Theorem  II. 2: 

Note  that 

H  :=  CKd+FGK)"1 
~yr  ~~  ~ 

=  F  1FGK(I+FGK)  '  (since  F  is  invertible) 

=  F_1FGK[ (I+(FGK)”L) (FGK) ]_i  (since  FGK  is  invertible) 

=  F'1(I+(FGK)“1r1  (A.l) 

To  estimate  H  r  for  r  ,  we  consider  first  z  :=  [I+(FGK)  ^]  *r. 

~yr  d,e  ~  —~ 

To  obtain  for  any  T  G  z-j-,  note  that  r  =  (I+(FGK)  ]z,  hence 

ZT  =  rT  ~  (FGK)  ^z,j, .  Now  the  Lipschitz  constant  [13,  p.  63]  of  the  right 

hand  side,  over  //  (R ,  ),  is  yd (FGK)  l]  <  1.  By  assumption  (a3)  ,  the 

d ,  e  l  - 

successive  approximations  starting  with  z  =  r  remain  in  A/iR*  )  forever; 
since  the  contraction  constant  is  <  1 ,  we  have  that 


] 


r 


< 

T  - 


|  (F(JK)-1r|T 

HtKm)'1) 


(A.2) 


Thus,  for  eacli  T 

|Hyrr-F_1r|T  =  |F_1(r-e)-F"1r|T 

-  |F_l[l+(FGK)~1]“1r-F"1r|T 

X(F  S  |  [I+(FCK)  *]  ^r-r|T  (by  assumption  (i)) 

,  | (FGK)_1r ) _ 

<  A(F  )- — — - -  (by  (A.2)) 

~  l-YTt(FGK)'  ] 

In  particular,  if  eqns.  (IT. 10)  and  (II. 11)  hold,  i.e.  for  T  €  C7  sufficiently 
large, 
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I 

; 


Proof  of  Th eorem  II .  3 : 

Since  F  is  invertible,  we  have,  from  Fig.  1.1, 

y  =  H  r  =  F_1 (r-e) 

~y  r  ~ 

Hence,  for  T  sufficiently  large,  Vr  G  ^  , 

d,e 

|Hyrr-flrlT  "  If^r-eJ-F^r^ 

<  X(F  ^ )  I e i rj.  (by  assumption  (i)) 

-  A(F_1) | C I+FGK)-1 r |T 

<<  (f  ^r|  (by  assumption  (ii))  Q.E.D 

Proof  of  Corollary  II. 3.1: 

?yrr~  J  r  =  F  (r~e)  -  F  r  =  -  F  ^e  (since  F  ^  is  linear) 

«  -  F_1(I+FGK)_1r 
=  -  [ (I+FGK)F]_1r 

=  -  [F(I+CKF))  ■* r  (since  F  is  linear) 

=  -  (I+CKF)- 1  F_1r 
Hence  for  T  €:  sufficiently  large, 


|Hyrr  ~  F_1rlT  -  |(I-WKFf1F“lrlT 


<<  -1 

'F  r1  (by  assumption) 

Q.E.D. 

Proof  of  Corollary  II. 3 .2 : 

Consider  the  system  S  in  the  sinusoidal  steady  state  (since  the 
closed-loop  system  is  exp.  stable  bv  assumption  (a2))  with  input 
r*exp(ju)t)  and  error  e* exp(jLi)t)  ,  where  r,  e  €  <£  .  Then,  by  linearity 
of  F(jw), 

Hyr(jw)r  =  F(jo))_I(r-e)  =  F(.jw)_1r  -  F( jw)~1e 

Thus 

Hyr ( jto)r  -  F( joj)  =  -F(jw)  ^e 

=  -F(jw)~1[(I+FGK)(jU))r1r 
=  -[ (I+FGK)F] (jw)_1r 

-[ F( jw)  (I+GKF)  ( jco)  ]  r  (by  linearity  of  F(juj)) 

=  -[  (I+GKF)  ( jco)  ]_1F(  ju))”^r 

Hence 

|Hyr(jw)r-F(.1u))_!r|  =  |  [  (I+GKF)  (Ja))]"1F(jw)'1r| 

<<  |F(ju)  ^r|  (by  assumption  (11.21))  Q.E.D. 

Proof  of  Theorem  III. 1 : 

AH  :  =  il  -  H 
~yr  ~y r  ~yr 

=  GK(I+FGK)_1  -GKd+FCK)-1 
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GK(I+FGK) 


GK ( f+FGK) 


+  GK( I+FGK)  -  GK( I+FGK) 


GK( I+FGK) 


GK ( I+FGK)  \ I-F*AG*K(I+FGK) 


+  AG *K( I+FGK) 


Evaluating  eqn.  (A. 3)  at  r  C 


AH  (r)  =  GK( I+FGK)  (r>GK( I+FGK)  (r+Ar)  + AH  (r) 


where 


r+Ar  :=  [  I-F*  AG*K(  I+FGK) 


Since,  by  assumption,  H 


GK( I+FGK)  is  a  C  map,  we  can  evaluate 


AH  (r)  by  the  Taylor's  expansion  theorem  [19,  p.  190]  and  obtain 


D[GK( I+FGK)  1  (r+oAr)  *Arda+AH  (r) 


D(CK)  •  [  I+F*D(GK)  ]  ‘Arda+AH  (r) 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r+aAr) 


Note  that  eqn.  (A. 5)  implie 


Ar  =  { [ I-F*AG*K(I+FGK) 


F* AG ‘K( I+FGK)  [ I-F*AG*K(I+FGK)  ]  (r) 


F • AG *K- (I+FGK)  (r) 


Thus 


D(GK)  •  [  I+F*D(GK)  ]  •  F*AH  (r)da+AH  (r) 

i  -  ~  ~  ~ynr  -ynr 


-f  D(GK)‘F[ l+U(GK) •F]'1du‘&H  (r)+AH  (r) 

Jo  —  ~  ~  —  ~  ~y0r  ~yor 

(since  F  is  linear) 

f1  •  _i 

1  (I-D(GK)  *F[  I+D(GK)  *F ]  }da*AH  (r) 

Jo  '  - .  ~yo 

l  [I+D(GK) *F]-lda*AH  (r) 

J0  -  ~~  ~  ~>’0r 


Eqn.  (A. 7)  is  true,  Vr  G  d  ,  thus  eqn.  (ITT. 4)  follows. 


Proof  of  Proposit  ion  1 1 1. .  2 : 
Note  that 


GK(I+FGK)_1  =  (I+GKF)_1GK  (since  GK  is  linear) 
and  that 

(since  K^ 

(since  GK, 

Thus  eqn.  (III. 10)  follows  from  eqn.  (III. 9). 


gk2(i+f2gk2)_1k1[i+f1gk2(i+f2gk2)'1k1]~1 
«  GK2 ( T+F 2GK2) " 1 l I+I^F jGK2 ( I+F2GK2) _1 1 
=  GK2t  £+(^2+k1f1)c;k2]~1k1 
-  U+GK2(F2+K1F1)f1CK2K1 


Proof  of  Proposition  III. 3: 


AH  :=  GKd+FGK)"1  -  CK(I+FGK)  1 

~yr  . . 

=  GK(I+FGK)_1[I+AF ‘GKd+FGK)-1]  1  -  GK(I+FGK) 


Evaluating  eqn.  (A. 8)  at  r  G  we  have 


AH  r  =  GK(1+FGK)_1 (r+Ar)  -  GK(I+FGK)_1 (r) 

-yr  -  - 


where 
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(A.  7) 

Q.E.D . 


is  linear) 

is  linear) 

Q.E.D. 

(A. 8) 

(A. 9) 

I 


r+Ar  :=  [I+AF*GK(I+FGK)_i  ]_1r 


(A. 10) 


Since,  by  assumption  (a3),  GK(I+FCK)  ^  is  a  map,  we  can  evaluate 
AH^r  by  the  Taylor's  expansion  theorem  and  obtain 


=  (  D(G1 

Jo  " 


AHyfr  =  I  D(GK) • [ I+F*D(GK) ]  drrAr 


(A. 11) 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r+aAr) ,  and 
DF  =  F  since  F  is  linear. 

Note  that  eqn.  (A. 10)  implies  that 


=  { f I+AF«GK(T+FGK)~ 1 ]_1-I } r 
=  -AF*GK(  I+FCK)-1  [  IH-AF  *GK( I+FGK) _1]_1r 
=  -AF *GK( I+FCK) _1r 


=  -AF*H  r 
~  ~yr 


Thus  eqn.  (A. II)  becomes 


HH  r  =  -(  D(GK)*[I+F*D(GK)]-1da*AF*H  r  ( 

~yr  Jq  —  -  -  ~y r 

r1  ~  _! 

=  -1  D (GK) * [ I+F • D (GK) ]  Fda-F  *AF*H  r  (since  F  is  invertible) 

Jo  - .  ~  '  'y 

=  -[  D(GK)F*[I+D(GK)*F]-1da*F-1*AF*H 

j  o .  -  ~y 

=  [I+D(GK) *F]-1da-l} *F_1*AF*H  r 

JQ  ~  ~~  ~  '  ~  - yr 


since  F  is  linear)  (A. 12) 


[I+D(GK) •F]_1da*F"1*AF«H  r  (since  F  is  linear) 
~~  ~  -  ~yr 


(l  [ I+D(GK) •F]_1da- 1} * F~ 1  * AF *H  r 

J n  ~  -  ~  ~yr 


AHyr  =  (I+D(GK)F]~lda-l}*F-l*AF*H^r  ,  on  ^ 


Since  H  is  invertible,  we  have 

-yr 


Ml  *H  1  =  {( 
~yr  ~yr  J0 


[I+U((5K)F|  1dnt-l }  - r“ 1  *AF  ,  on 


Q.E.D. 


Proof  of  Proposition  II T . A : 

For  completeness,  we  first  state  an  algorithm  [36]  which  determines 
the  asymptotic  behavior  of  the  zeros  of  a  polynomial.  This  algorithm  is 
a  direct  application  of  the  Newton's  diagram  (or  known  as  the  method  of 
Puiseux,  see  e.g.  [35,  p.  105]). 


Algorithm: 


Data:  Polynomial  P(s,k)  =  ^^a^(k)s  '  G  F[s ] 

where,  for  i  =  0,1,2,. ..,n 


af,(k)  =  ’  k’  a?i  ’S  €  R 

ct  t  0  ,  and  a.  f  0  ,  VO  <  <  n-1  such  that  m0  >  0 

nm  x,m„  —  *■ 

n  9 

Step  1:  Find  i  G  and  T  ,  q  G  J)  ,0  <  p  <  i, where  i,  x  's,  q  's  are 
such  that 

(i)  i  is  the  largest  integer  such  that  0  ■  x^  <  <  • • •  <  T^; 

(ii)  q  =  max{m  ,m  , . . . ,m  }; 

o  U  1  n 

(iii)  for  0  £  p  <  i, 

mn  <  q  -Jl*x  ,  VO  <  H  <  n 
with  equality  holds  for  at  least  two  Z's; 

(iv)  if  i.  (1^)  is  the  smallest  (largest)  £  such  that  m^  =  q^-i^X^,  then 

for  p  =  0,1,..., i-1.  (The  procedure  of  finding  i,  Tp's>  qp's 
can  be  best  illustrated  graphically  by  the  m„  .ified  Newton's  diagram 


shown  on  Fig.  A.l.) 
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Step  2:  For  each  0  <  p  <_  i,  form  the  polynomial 


<t>  (z)  =  X,  n  z 

P  -Hn  =q  )  ? 

P  P 


(A. 13) 


Step  3:  Calculate  the  zeros  of  $  and  denote  them  by  z  ,  j  =  l,2,...,n 

J  U  J  l 

Calculate  the  nonzero  zeros  of  <p  ,  1  <  p  <  i,  and  denote  them  by  z  . , 
-  >  -  -  Pj 

j  “  1 » 2 , . . . , n^ . 

Step  4;  As  |k|  ■*  00 ,  the  n  zeros  of  the  polynomial  P(s,k)  behaves  as 


2pjk  '  J  "  1’2>-'-’nP  *  I’  =  0.1,2,...,! 


where  n  >  1,  for  1  <  p  <  i,  and 

p  -  -  ~ 


n  =  n  . 


Now  we  can  apply  this  algorithm  to  prove  Proposition  III. A.  Without 

loss  of  generality,  we  only  have  to  prove  the  case  where  n  *  n.  and 

o  1 

M  =  In  •  Note  that 
o 

det [ 1+kG]  =  1  +  k[ trace  G(s)] 

2r 

+  k  [E  principal  minors  of  G(s)  of  order  2] 

+  •  •  •  +  km  det  G 


n  J,nVn  (  n 

^ aij  i.j  iJ  11  & 


d.  .)  +  •••  +  k  •  n  d  *det  G] 


~pr~j  [  n  d  +  ka  (s)  +  k2a  (s)  +  •  •  •  +  k^a  (s)  ] 

1,J  J 


where  (s)  €*[s],  j  =  l,2,...,m. 


Let  3[  n  d  ]  =  n.  Since,  by  assumption,  3d  .-3n  ,  3,  Vi,j  =  1,2, 

i,j  3  3  3  " 

we  have  that  3[u^(s)]  £  n-3J ,  J  =  1,2,..., in.  Hence  with  i  defined  in 


Step  1  of  the  algorithm  above. 


<J>i(z)  =  7.n  +nt,pzn  k  +  •  •  *  .  P  *  3  • 


where  4k(z)  is  defined  in  (A. 13). 


Now  we  claim  that  $  (z)  has  t;+-7.eros .  To  see  this,  consider  some 
e  >  0  sufficiently  small;  apply  tlie  Routh  test  (see  e.g.  [37])  to  the 
polynomial  <}>.(z+£:).  Since  &  >  3,  the  first  column  from  the  left  in  the 


Routh  array  contains  some  strictly  negative  numbers,  thus  <P^(z)  has  some 

o  Ti 

C+-zeros.  Hence  as  k  -►  ",  dot  [I.+kC]  has  zero  behaves  as  z^k  with 


z^  G  C+  and  >  0. 


Q.E.D. 


Proof  of  Proposition  III. 5: 

(i)  By  definition,  Gu  :=  Gu+d  .  Then,  by  eqn.  (III. 4)  (of  Theorem  III.l), 

~  u 

we  have  that 


A  _  _i 

Ay  -  AH  r (r)  =  1  [ T+D(GK) *F ]  da*dQ  (since  AHy  r(r)  =  dQ) 

■£ 


[I+D(CK)*F]  da*dQ  (since  D(GK)  =  D(GK) ) 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (1+FGK)  (r+aAr)  with 


Ar  =  F»  AH  (r)  =  F‘dn. 

-  -V  '  ° 


(ii)  By  definition,  Fy  :=  F(df+y)  =  Fdf  +Fy  (since  F  is  linear).  Then 


AF*y  =  (F-F)y  =  F*df 


(A.U) 


Thus,  following  the  proof  of  Proposition  III. 3,  in  particular,  eqn.  (A. 12) 
we  have  that 


-£ 


,-i 


Ay  =  -I  D(GK) [ I+F*D(GK) ]  da*AF*y  (since  D(GK)  =  D(GK)) 
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_ 1  Kttiitil 


w  S 


MM" 


(by  eqn .  (A. 14)) 


D(GK)[I+F*D(GK)]-1Fda*d  . 

o  . .  f 


=  -f  D(GK.)  *F[  I+D(GK)  *F]  'da*d  (since  F  Is  linear) 

j0  ~~  ~  -  —  ~  1 

=  {(  Il+D(CK)«F]-Ida-I}*df 

J0  ~  ~~  ~ 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FCK)  ^(r-KxAr)  with 

Ar  =  -AF*H  r  =  -AF*y  =  -Fd.  and  a  G  (0,11.  Q.E.D. 

~  ~yr  -  ~  f 


Proof  of  Proposition  III. 6: 

By  definition,  Gu  :=  G(u+dg) .  Then  by  eqn.  (III. 4)  (of  Theorem  III.l) 
we  have  that 


Ay  =  f  [ I+D(GK) •F]_1da* [G(u+d  )-G(u)] 

J o  ~  ~~  ~  8  ~ 

(since  AH  (r)  =  C(u+d  )-G(u),  where  «  =  K(I+FGK)  r) 
~y0r  ~  8  ~ 

/■l  __  ■.  el 

=  (I  [I+D(GK)*F]  da} • {I  DG(u+Bd  )dB}*d 
Jq  ~  ~  Jq  ~  8  8 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  ^(r+aAr)  with 
Ar  =  F[G(u+dg)-G(u)]t  u  :=  K(I+FGK)_1r,  and  aG  [0,1].  Q.E.D. 


Proof  of  Proposition  III. 9: 


5T(N9,tA)  :=  inf  sup  |n„u-Lu| 

L&C  UEV  ~  1 

=  inf  sup  |n  u+L  u-Luj 
LGjC  u£V  -1  ~  1 

=  inf  sup  |N  u-L'u|_ 

L'&C  uGV  -  1 

VT  G!f  ,  W  C  u  . 

v 


wv)  * 


Q.E.D. 


Proof  jnf  Proposition  1 1 1  . 1 0: 

|5t(N,V1)  :=  inf  sup  |Nu-I.u| 

1  ~  L  ve£  u ev  ~  ~ 

<  inf  sup  |Nu-Lu(  (since  C  1/  C  U  ) 
l££  i fit'  ~  ~  1  L  6 

=  :  6t(N,K0)  .  VTSy  .  Q.E.D. 

Proof  of  Proposition  TT1.1 1 : 

Note  that  DN(0)  €1-  Hence 

0  <  6  (N,B  (0;B) )  <  sup  |Nu-DN(0)u|  (A. 15) 

1  ~  u£BT(0;a)  ~  “ 

By  the  definition  of  Frechet  derivative,  we  know  that  for  any  E  >  0, 

36  >  0  such  that  |  Nu-DN (0)  *u | ^  _<  e  |  u ) ,  v|u|T  £  6.  Hence  as  (3  0, 

the  right-hand  side  of  eqn.  (A. 15)  tends  to  zero  and  6^,(N  ,§^(0 ;  8) )  -*■  0. 

Q.E.D. 


Proof  of  Proposition  III.] 2 : 

Let  W  C  If,  for  some  L  £  Nu  =  Lu,  Vu  £  then  L  is  a  minimizer  of 

sup  |Nu-Lu|  ,  VT  £*T,  and  6  (N.if)  =  0,  VT  £37'.  In  particular,  if  N  £<£, 
u£V  ~  ~  T  1  ~ 

then  N  is  a  minimizer  of  sup  |Nu-Lu|  ,  VT  £3^,  W  C  ft  ,  hence  6  (N,1r)  =  0, 

UGV  ~  1  e 

VT  £X  VVC  U  .  Q.E.D. 

e 


Proof  of  Proposition  III. 13 : 

By  assumption,  for  some  T  £  O', 


<$_(N,‘t/')  !“  inf  sup  |Nu-Lu|  =  0  (A. 16) 

T  ~  L&4  UGV  ~  ~  1 

oo  ^ 

Thus  for  this  T,  there  exists  a  sequence  (L^) ^=q  £ such  that 


sup  |Nu-L  u|  +  0,  as  i  ■*  “  (A.  17) 

u£V  - 
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mmammammm 


or  equivalently 


and  choose  the  corresponding  >  0 


such  that  (A. 18)  holds,  then 


(by  definition  of  the  induced  norm, 
with  6  defined  in  assumption  (a3)) 


(by  (A. 18)  and  the  choice  of  m  ) 


Thus  is  a  Cauchy  sequence  in  (P^sC,  j*|^,). 

Note  that  for  each  T  £  ST’,  (P^af,  1*1^)  is  a  Banach  space  with  the 
usual  induced  norm  since,  by  assumption  (al)  ,  P  ■if  is  a  Banach  space 


Note 


By  (A. 18),  (A, 19)  and  the  assumption  (a2)  that  sup  |u|  <  00 ,  the  right 

Un¬ 
hand  side  of  eqn.  (A. 20)  tends  to  zero  as  i  -*■  nD.  Hence  |Nu-L*u|_  ■  0, 


Proof  of  Theorem  III.  14 


Let  L„  be  a  linear,  causal  operator  such  that  the  linear  operator 


H  r  -  L  r  =  GK( I+FGK)  r  -  L„K(I+FL„K)  r 
~yr  ~yr  ~~  -  ~G~  -  ~ ~G~ 

=  GK(I+FJK)_1r  -  LK( I+FGK) _1r 
~  **  Cl  "*  — 

+  L„K(I+FG.K)"lr  -  I._K( I+FL„K) _1r 


+  L„K(1+FL_K)  [(I+FL„K)  -  (I+FGK) ] (I+FGK)  r 


(since  1?,  L  ,  K  are  linear  and  u  *  K(I+FGiC)  r) 


(G-L  ) u  +  L  K( I+FL  K)  AF( Lr-G) K(I+FGK)  r, (since  F  is  linear) 

~  ~  (j  -u'  **  *”  "•  Cj-  -  -u  -  -  -  —  —  —  - 

(G-L,,)  u  -  L  K(  I+Fl  K)”1F(G-L„)u.  (since  F,L  ,K  are  linear) 

-  -  (j  -Cj"  -  "  "u  Cj 

[I-L  KF(I+L  KF)_11 (G-L  )u, (since  F  is  linear) 


Thus 


provided  that  P  (C-Lr)u  t  0 


is  defined  in  eqn.  (III. 25) 


L„K(1+FL„K) 


where  L 


On  letting  L 


we  have 


<_  sup 


| (I+L*KF)_1 y | , 


sup  | Gu  -  L  u! 
u£ft,  '  'G  T 

d,e 


p.  «T(9Ad,„> 


(A. 23) 


whereby  :=  (C-L„)%.  and  p  is  defined  in  eqn.  (III. 27).  Note,  the  last 
7e  -  - C  d ,e 

inequality  follows  since  when  r  G  $ ^  ^ ,  the  corresponding 


u  :=  K(I+FGK)  r  G  <U  . 
~  .  d,e 


Q.E.D. 
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FOOTNOTES 


In  describing  the  feedback  system  under  consideration,  we  adopted  the 
control  terminology,  i.e.  the  power  stage  of  the  amplifier  is  called 
the  plant;  the  preamplifier  is  called  the  compensator;  etc.  We  trust 
that  this  will  cause  no  great  inconvenience  to  feedback  amplifier 
enthusiasts. 

(2) 

In  the  single-input  single-output,  linear,  t ime- invariant  case, 
pB  =  however,  if  any  one  of  these  three  conditions  fails,  one 
must  write  Bp.  We  do  so  to  he  self-consistent. 

(3) 

An  operator  N  is  continuous  on  an  extended  space  iff  VT  G  ,  P^,N 
is  continuous. 

^If  A  G  <In  n,  the  largest  singular  value  of  A  is  the  square  root  of  the 
largest  eigenvalue  of  A*A,  where  A*  denotes  the  complex  conjugate  of 
A;  it  is  also  the  J^-induced  norm  of  the  linear  map  A:  Cn  -*•  <En. 

^'^Note  that  for  any  physical  system,  [I+G(jw)K(ju)l'(jw)  ]  ^  -*■  I  as 

I co |  -+  ®.  Hence  it  is  impossible  to  fulfill  this  requirement  for  all 
u>  G 

^Recall  that  if  for  some  (i,j),  n„(s)  3  0,  then 

^^The  results  of  this  section  were  obtained  with  the  collaboration  of 
A.  N.  Payne. 

/  Q\ 

'A  function  y(‘):  K+  Rn  is  said  to  be  asvmptot ically  T-per iodic  iff 

y(-)  =  yT(*)+y0^'^*  where  yT( • )  is  a  T-periodic  function  and  yQ(t) 

tends  to  0  as  t  -►  «*>. 
n 

G  ft  is  said  to  be  Frechet  differentiable  at  x  iff  VT  Pj,N  is 

Frechet  differentiable  at  x. 

G«£  is  said  to  be  continuous  iff  VT  ^cT,  PTL  is  continuous,  i.e. 

Mx 

VT  |l|  :=  sup  -T-T-  <  ®. 

1  u£2f  '  u  I  t 

|  u  |  T?*0 
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There  has  been  considerable  interest  lately  in  the  application  of  singular 
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I.  INTRODUCTION 


Although  there  has  been  considerable  interest  lately  in  the  application 
of  singular  value  analysis  in  systems  theory,  [l]-[9] ,  the  basic  analysis 
techniques  involved  are  at  least  46  years  old.  Hotelling  [10],  [11],  intro¬ 
duced  principal  component  analysis  in  1933,  and  the  effectivenss  of  these  tech¬ 
niques  was  enhanced  substantially  by  the  development  of  an  algorithm  (S.V.D.), 
[12],  for  efficient,  accurate  computation  of  the  important  objects.  These 
techniques  are  currently  used  in  the  numerical  analysis  [ 13] - [  15] ,  and  digital 
filtering  f 16] - [ IS] .  Dempster  [19]  gives  an  excellent  geometric  treatment  of 
principal  component  analysis  as  well  as  an  overview  of  its  history  and  relation¬ 
ship  to  least  squares  approximation. 

In  this  paper  the  fundamental  results  underlying  these  analysis  tools  are 
presented  (Section  II),  and  a  preliminary  method  (using  these  tools)  for  on-line 
tuning  of  multivariable  proportional-plus-integral  controllers  is  proposed 
(Sections  III,  IV).  When  the  method  is  applied  to  a  set  of  non-interacting  loops, 
it  reduces  to  a  standard  classical  technique  ([20],  page  330). 

Although  the  point  will  not  be  pursued  here,  linearity  does  not  play  an 
essential  role  in  principal  component  analysis.  Preliminary  ideas  on  the  applica¬ 
tion  of  these  tools  to  nonlinear  problems  are  given  in  [21] . 

Notation :  1R  ,  will  represent  the  fields  of  real  and  complex  numbers.  For  a 

T  t  *  * 

vector  v  and  matrix  M,  v  ,M  represent  the  transpose,  v  ,M  represent  the  complex 
conjugate  and  v^,M*'  represent  the  conjugate  transpose. 


II.  FUNDAMENTAL  RESULTS 


The  results  given  in  this  section  form  the  foundation  for  the  principal 
component  analysis  techniques  to  be  discussed  in  later  sections.  The  two 
propositions  given  below  may  be  viewed  as  one  result  stated  in  two  different 
contexts:  the  first  involving  discrete  data  samples;  the  second,  continuous 
data.  The  constant  K  plays  no  role  other  than  an  aid  for  discussion. 

Discrete  Data: 

For  convenience  the  samples  are  organized  into  a  sequence  of  vectors 
y(l)  »y(2) , . . .  ,y(N)  in  <fn,  with 

?  A  N  u 

W  =  K  l  yiDyU)-  (K>0) 

1=1 

This  matrix  is  positive  semidefinite  with  a  set  of  non-negative  eigenvalues 

2  2  2 
a.  2  a,  2  ...  £  a  2  0 
12  n 

and  corresponding  mutually  orthogonal  unit  eigenvectors  ui>u2*"'*un* 
Proposition  1A: 

Let  the  scalar  sequence  y^(l) ,y^ (2) , . . . ,y^ (N)  be  defined  by 
•  u^y(f) 

n 

for  1  s  i  s  n.  Then  y(£)  =  [  u.y.  (1) ,  whore 

i*l  1  1 


Proof :  The  first  identity  follows  from  the  fact  that  —  ,un)  is  unitary. 

Furthermore 

K  IllXi^ll2  =  K  l  u“y(£)y(£)Hu  =  uVu. 

1=1  1  1=1  1  ill 

and  the  second  identity  follows  trivially.  □ 


Stated  in  other  words,  Proposition  1A  says  that  we  can  decompose  the  vector 
sequence  into  the  vector  sum  of  spacially  orthogonal  sequences  (called  components) 
ordered  with  respect  to  magnitude. 

The  important  objects  in  Proposition  1A  are  the  pairs  (o^,u^),  i=l,...,n, 

2 

and  these  can  be  computed  without  first  computing  W  .  If  a"  data  matrix  Y  is 
constructed  with  N  columns  consisting  of  the  vectors  y (1) ,y (2) , . . . ,y(N) ,  then 


and  (ck,u^),  lsisn,  are  the  singular  values  and  left  singular  vectors  of  Y.  These 
may  be  computed  directly  using  the  well  known  algorithm  (S.V.D.)  developed  by 
Golub  and  Reinsch  [12]  (see  also  [9]). 


Continuous  Data: 


Here  we  decompose  the  vector  valued  function  into  the  sum  of  spacially  ortho¬ 
gonal  component  functions  ordered  with  respect  to  magnitude.  The  same  computational 

2 

tool,  S.V.D.,  can  be  used  to  compute  (o^,u^)  without  actually  computing  W  .  To 
do  this,  divide  [x^.x^]  into  N  evenly  spaced  sample  points  and  construct  a  data 
matrix  Y  whose  columns  are  the  samples.  For  N  large,  rectangular  approximation 
of  the  integral  gives 


I*2  fCxJfV^dx  »  (VN)YYH 
j*l 

To  compute  lsisn,  one  may  apply  S.V.D.  to  the  scaled  data  matrix 

(K/N)1/2Y 


-7' 


To  compute  (<k,u^)  in  this  situation,  divide  [Xj.Xj]  into  N  evenly  spaced 
sample  points  s1,s2> . . . ,sN,  and  let 


Y  =  (F(sJ  F(sJ  ...  F(sJ). 


If  there  are  m  columns  in  F  and  N  sample  points,  then  Y  has  mN  columns. 


Remarks  about  Perturbations: 


Suppose  the  matrix  F(x)  is  perturbed  to  give  F.(x)=F(x)+AF(x) .  Then 


u»F 


H. 


.FA(x)  =  F.(x)  ♦  u?AF (x) 


and  it  follows  that 


2||F.(x)-u“FA(x)  ||2  dt 


1/2 


f2  ||  AF  (x)  ||  2  dx 

J  Y 


1/2 


where  the  equality  is  achieved  if  AF(x)  is  aligned  with  u^. 

This  is  a  double  edged  sword.  First,  it  gives  a  tool  for  coping  with  structural 
instability  associated  with  many  theoretical  results.  Theory  says,  for  example, 
that  if  every  column  of  F(x)  is  contained  in  a  proper  subspace  S  for  all  xcfxj.x^], 
then  we  may  project  onto  S  to  simplify  the  situation  (by  reducing  dimensionality). 

Such  a  subspace  S  may,  however,  be  structurally  unstable:  there  may  exist  arbitrarily 
small  admissable  perturbations  such  that  the  columns  of  F(x)«-AF(x)  are  not  contained 
in  a  proper  subspace.  We  are  guaranteed,  however,  that  FA(x)  will  have  weak  components 
(assuming  small  perturbations)  and  that  the  strong  components  will  define  a  subspace 
which  is  close  to  $. 


!l 


The  other  edge  of  the  sword  gives  us  help  in  deciding  roughly  how  accurate 
we  can  expect  the  components  to  be.  If  for  example,  there  are  components  whose 
magnitudes  are  of  the  same  order  as  the  instrumentation  precision,  then  they 
may  be  in  error  by  »100%  and  one  can  hardly  use  them  (say  for  feedback)  with 
confidence. 


General  Comments  about  Applications: 

The  results  of  this  section  provide  a  strong  tool  for  spacial  analysis 
(possibly  on-line  in  many  situations)  of  multivariable  signals  in  the  time  or 
frequency  domains. 

If,  for  example,  f(t)  is  a  vector  of  signals  and 


f(t)fT(t)dt 


then  Proposition  IB  gives  a  decomposition  into  components  ordered  with  respect 
to  their  energy  (K=  1)  or  average  power  1 K  =  1  :■ 


f?(t)dt 


1/2 


°i 


For  a  vector  f(jw)  in  the  frequency  domain,  and 


W 2  =  f2  f(jw)fH(jw)dw, 


one  gets  information  about  the  spacial  distribution  of  f(jw)  over  the  frequency 
band  [Wj ,w2] . 


> 

t 


i 

I 

- 


,  „ . 


Remarks  about  Computation: 


-<? 


Although  one  might  be  alarmed  at  the  thought  of  using  a  minicomputer  to 
compute  the  singular  values  and  left  singular  vectors  of  a  matrix  Y  with,  say, 

10  rows  and  100  columns,  it  is  quite  reasonable.  One  can  recursively  (treating 
one  column  of  data  at  a  time)  reduce  Y  to  a  unitarily  equivalent  matrix  (see  [14] , 
p.  383) 

Y  =  YQ  (Q  unitary) 

A  2 

where  Y  is  10*10;  this  process  requires  «100(10  )=10,000  operations.  Singular 

A  T 

value  decomposition  of  Y  requires  k6(10  )=6000  operations,  giving  a  total  of 
operation  count  of  «16,000. 

At  first  it  may  seem  simpler  to  find  the  components  by  computing  the  eigen¬ 
values  and  eigenvectors  of  YY».  Experts  recommend  that  this  be  avoided  (by 
using  S.V.D.)  for  the  following  reason  (see  [14],  p.  382  for  more  discussion): 

This  method  doubles  the  demand  for  internal  computer  resolution  associated  with 
the  algorithm. 

Specifically,  suppose  one  has  invested  money  in  12  bit  A-D  converters  and  has 
interfaced  these  properly  so  that  there  is  12  bit  resolution  associated  with  the 
data.  To  get  this  same  resolution  on  the  span  [0,CJj];  that  is,  to  have 


-12  -12 
CTi  -  2  ^  s  {computed  value  of  +  2 


requires  at  least  12  bit  internal  resolution  using  S.V.D. ,  and  at  least  24  bit 
internal  resolution  using  the  "squared  up"  version  where  yy”  is  computed. 


L_ 


-  i 


-  -  — — 


.V. 


Stated  in  other  words,  possibly  more  to  the  point  with  current  minicomputer 
hardware  organization,  it  is  highly  probable  (work  needs  to  be  done  here)  that 
one  can  get  12  bit  resolution  with  12  bit  A-D  converters  and  16  bit  operations 
if  S.V.D.  is  used.  It  is  impossible  to  do  so  with  the  other  algorithm;  one 
would  probably  need  to  carry  out  the  computations  using  32  bit  arithmetic. 


-if ' 


III.  MULTIVARIABLE  PI  CONTROL 

Consider  the  following  PI  (Propcrtional+Integral)  control  loop  which  is 
Assumed  to  be  open  loop  stable: 


With  a  single  isolated  loop  such  as  this,  one  can  often  follow  a  simple 
procedure  to  adjust  the  gains  k^,  k^;  i.e.  to  "tune"  the  control  loop.  One 
classical  method  (see  [20J,  p.  330)  is  the  following: 


•with  kj=0  increase  kp  (this  improves  response  speed)  until  the  step  response 
is  highly  oscillatory.  Reduce  k^  by  a  factor  of  2. 

•increase  kj  (this  reduces  offset)  until  the  step  response  is  highly  oscillatory. 


Reduce  kj  by  a  factor  of  2. 

With  multiple  interacting  PI  control  loops,  there  are  inherent  "traps"  asso¬ 
ciated  with  extending  simple  procedures  such  as  this.  To  bring  some  of  these 
problems  into  closer  view,  consider  the  system  shown  below 


r(t) 


■y(t) 


_ - . 


„  — 


where  K^,  Kj  are  diagonal  matrices  of  proportional  and  integral  gains,  respectively. 
Let's  assume  that  each  variable  is  scaled  so  that  one  unit  corresponds  to  a  fixed 
percentage  of  "full  swing"  and  that  we  are  free  to  sample  e(t),  the  error  vector. 

Let  E(t)  be  the  matrix  made  up  of  error  responses  to  unit  steps;  i.e.  the 
i**1  column  of  E(t)  is  the  error  response  to  a  unit  step  applied  to  the  it*1  reference 
input.  For  a  linear  system,  the  response  to  an  arbitrary  vector  of  steps 


r(t)  =  r  6(t) 


is  given  by 


e(t)  =  E(t)r. 


The  steady  state  error  (assuming  stability)  is 


e  =  E  r 
ss  ss 


where  E  =  limit  E(t). 

ss  .  v  J 

t-X» 


A  major  trap  follows  from  the  fact  that  an  operator  sees  only  projections 
of  the  vector  e(t)  on  the  basis  vectors  of  a  fixed  coordinate  system  associated 
with  the  physical  arrangement  of  hardware  (sensors) .  It  is  possible  for  rather 
simple  mechanisms  to  appear  complicated  in  this  fixed  coordinate  system.  The 
following  paragraphs  show  that  simple  mechanisms  involving  the  notions  of 
settling  time,  oscillations,  and  steady  state  errors  may  be  confusing  when 
viewed  through  projections. 


V.W  '  ■  '*  I 


T 


-t* 


Settling  Time: 


Lot  T(t)  *  Eft)  -  E  be  the  transient  response  map  so  that 
ss 


e(t)  =  etr(t)  ♦  ess 


where 


etr(t)  =  T(t)r 


It  is  certainly  possible  for  the  response  to  have  one  sluggish  component  which 
projects  significantly  onto  each  coordinate;  i.e.  all  loops  appear  sluggish. 


follows:  Let 


W2(t)  *=  J~  T(r)TT(T)dT 


2  2  2 

with  eigenvalue,  eigenvector  pairs  (Oj (t) ,Uj (t) ) , (o2(t) ,u2(t)) , . . . , (°n(t) »un(t)) 
Then 


r  in „ ,•  -ASHiMmmuiii ~i>  w  mr  m 


i! 


v.  A 


t  .  =  minimum  time  such  that  o^(ts^)  <  6. 

Note  that  t  .  2  t  ,  S  t  . 

si  s2  sn 

Further  on  in  this  section  we  shall  propose  one  procedure  for  "tightening" 
the  response  in  the  direction  associated  with  sluggish  components. 


Steady  State  Errors: 

2  A  T  2 

Consider  W  =  E  E  with  eigenvalue,  eigenvector  pairs  (a  .  ,u  ),..., 
ss  ss  SS  SS 1  ssl 

^°ssn,Ussn^'  **  *s  ent*rely  possible  that  there  are  only  a  few  strong  offset 
error  components  which  project  onto  every  loop 

loop  2 


Oscillations: 

To  avoid  unnecessary  complications,  let's  assume  that  there  is  a  single 

lightly  damped  sinusoidal  component  observed  in  the  loop  error  responses,  and 

(2tt/w 

that  the  observed  frequency  is  w.  Let  T  =  T(t)dt  and 

av  Jo 

2  f2lT/w  T 

\rS  Jo  (T(t)-TaV)(T(t)-Tav)Tdt 

2  2 

with  eigenvalue,  eigenvector  pairs  (otrl »utrl) » ■ • • » C°trn*utrnJ * 


Again  it  is  possible  that  there  is  one  strong  oscillatory  component  which 
projects  onto  a  number  of  loops 

loop  2 


A  tuning  method  which  allows  one  to  avoid  these  traps  is  given  in  the  next 


section. 


IV.  A  PRELIMINARY  ON-LINE  TUNING  METHOD 


These  ideas  are  preliminary  and  essentially  untested.  Undoubtedly  tests 
currently  in  progress  will  lead  to  better  tuning  methods  than  the  rather  vague 
one  proposed  in  the  x'ollowin^  paragraphs.  The  tuning  method  is  basically  the 
classical  technique  (given  in  Section  III)  applied  to  principal  components.  If 
loops  are  noninteracting,  the  method  reduces  to  the  classical  technique  applied 
to  all  loops  simultaneously. 

Part  1  Tightening  the  Response: 

Let's  assume  that  initially  Kj=0,  and  that  the  diagonal  components  of  Kp  are 
increased  (at  the  same  rate,  if  you  like)  until  there  is  a  highly  oscillatory 
component.  If  the  components  of 

T(t)  -  T 

have  magnitudes  atrj » • • • «°trn  which  are  roughly  equal,  then  this  step  is  essentially 
complete;  reduce  the  gains  by  a  factor  of  two  Cto  reduce  the  oscillations}  and 
proceed  to  Part  2. 

If  there  are  some  weak  components,  then  increase  gains  in  these  directions. 
Specifically,  suppose  atk>>atrk+1»  and  let 

U1  ^U1  u2  **•  uk^;  U2  =  ^Uk+1  ’*•  un^ ’ 

Then  in  the  proportional  branch,  we  insert 


where  a, 3  are  tuning  parameters  with  a=3=l  initially.  The  parameter  a  should  be 
increased  until  oscillations  appear  in  the  lower  branch;  it  may  be  necessary  to 
reduce  g  in  the  process  to  maintain  stability;  i.e.  to  keep  upper  branch  oscillations 
bounded. 

This  process 

•compute  components  of  T(t)-T 

•insert  a  Rotation-Tuning  Gains-Rotation  block 

•adjust  gains  to  get  oscillations  in  weak  branch 

can  be  continued  until  the  oscillations  are  "full"  with  no  weak  components.  The 

.  A  . 

resulting  gain  matrix  Kp  in  the  proportional  branch  is  the  product  of  Kp  and  the 
inserted  blocks.  The  elements  of  Kp  should  be  reduced  by  a  factor  of  2  to  reduce 
oscillations.  This  completes  Part  1. 


Part  2  --  Inserting  integral  gain  to  reduce  offset  errors: 


At  this  point  it  may  be  necessary  to  insert  integral  action  if  there  is 

A 

significant  offset.  Here  we  shall  use  the  components  of  Egs  (with  controller  K) . 


a  .  »  o  .  , 

fsk  ssk+1 


let 


U1  =  (ussl  uss2  **•  ussk);  U2  =  (ussk+l  ”*  “ssn5 
and  configure  the  controller  in  the  following  way: 


with  this  configuration,  a  should  be  increased  from  zero  until  oscillations  occur. 
If  the  oscillations  are  "full"  in  the  space  corresponding  to  the  integral  branch, 
reduce  a  by  a  factor  of  two  and  stop. 

If  the  oscillations  in  the  integral  branch  are  not  full,  we  may  proceed  as 
follows  iteratively  until  the  oscillations  are  full. 

•compute  components  of  Uj(T(t)-TaV)Uj 

•insert  a  Rotation-Tuning  Gains-Rotation  block  (as  in  part  1)  in  the  integral 
branch 

•adjust  gains  to  increase  oscillation  in  weak  integral  branch 

We  are  one  step  away  frjbin  completion  of  the  proposed  tuning  algorithm,  with 
the  following  controller  structure 


The  last  step  is  to  reduce  the  elements  of  Kj  by  a  factor  of  two. 


Concluding  Remarks: 

It  is  certainly  possible  in  many  process  control  problems  to  use  a  single 

* 

1 1 

microprocessor  system  (<$10,000)  for  multivariable  PI  control  of  a  small  number 
of  loops  (say  10) .  Process  control  systems  of  this  type  have  been  applied 
successfully  (see  [22],  [23])  in  the  control  of  industrial  heating  and  air 
conditioning  equipment  (boilers,  chillers,  cooling  towers,  air  handlers,  etc.). 
The  tuning  method  proposed  in  this  section  can  be  implemented  with  little  or  no 
additional  hardware.  The  procedure  is  simple  and  consistent  with  classical 
tuning  methods..  With  a  well  designed  man-machine  interface  (say  bar  graphs  for 
singular  values  and  automatic  generation  of  rotation  blocks)  the  method  would 
probably  be  acceptable  to  plant  operators. 
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ROBUST  STABILITY  OF  LINEAR  SYSTEMS  -  SOME 
COMPUTATIONAL  CONSIDERATIONS* 

by 

Alan  J.  Laub** 


1.  INTRODUCTION 

In  this  paper  we  shall  concentrate  on  some  of  the  computational  issues 
which  arise  in  studying  the  robust  stability  of  linear  systems.  Insofar 
as  possible,  we  shall  use  notation  consistent  with  Stein's  paper  [1]  and 
we  shall  make  frequent  reference  to  that  work. 

As  we  saw  in  [1]  a  basic  stability  question  for  a  linear  time-invariant 
system  with  transfer  matrix  G(s)  is  the  following:  given  that  a  nominal 
closed- loop  feedback  system  is  stable,  does  the  feedback  system  remain 
stable  when  subjected  to  perturbations  and  how  large  can  those  perturba¬ 
tions  be?  It  turned  out,  through  invocation  of  the  Nyquist  Criterion, 
that  the  size  of  the  allowable  perturbations  was  related  to  the  "nearness 
to  singularity"  of  the  return  difference  matrix  I  +  G(jco).  Closed- loop 
stability  was  said  to  be  "robust"  if  G  could  tolerate  considerable 
perturbation  before  I  +  G  became  singular. 


* 
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We  shall  now  Indulge  in  a  modicum  of  abstraction  and  attempt  to 
formalize  the  notion  of  robustness.  The  definition  will  employ  some 
jargon  from  algebraic  geometry  and  will  be  applicable  to  a  variety  of 
situations.  While  no  deep  results  from  algebraic  geometry  need  be  em¬ 
ployed,  the  exercise  of  formulating  a  precise  definition  is  a  useful  one 
for  clarifying  one's  thinking. 

Let  p  e  3RN  be  a  vector  of  parameters  from  some  problem  being  studied 
and  suppose  we  are  interested  in  some  property  II  of  this  data .  The  vector 
p  may  consist  of  the  elements  of  various  matrices,  for  example.  If  IT 
is  true  at  some  nominal  parameter  set  p^  we  are  frequently  concerned  with 
whether  IT  remains  true  in  a  "neighborhood"  of  pQ. 

For  exanqple,  pQ  may  be  the  elements  (a^,  ...»  a^,  a^,...,  a^) 
of  a  nonsingular  nxn  matrix  AQ  and  we  are  interested  in  the  nonsingularity 
of  nearby  matrices.  We  shall  proceed  to  formalize  the  often-heard  statement 
that  "almost  all  nxn  matrices  are  nonsingular".  First,  the  jargon: 

Definition  1;  A  variety  1/  =*  {p  e  ®N :  ■JMp^  •  •  •  *  PN)  =  °»  i  “  !»•••» 

where  ^(x^,...,  xN>  emtx^...,  are  polynomials. 

N 

V  is  proper  if  V  ?  TR  and  nontrivial  if  V  ?  4> . 

-Nr  1 

Definition  2:  A  property  is  a  function  IT:  TR  10,  1).  The  property 
IT  holds  if  n(p)  -  1  and  fails  if  II (p)  »  Q. 

Definition  3:  If  1/  is  a  proper  variety,  ft  is  generic  relative  to  1/ 
provided  IT  (p)  »  0  only  if  p  e  V.  A  property  IT  is 
generic  if  such  a  V  exists. 

Our  discussion  to  this  point  is  purely  algebraic.  Now  let  us  intro¬ 
duce  a  topology  on  IRN,  say  the  topology  induced  by  some  vector  norm  ||  •  ||  . 


- .  . 


Furthermore,  let  1/  be  any  nontrivial,  proper  variety.  Then  we  have 
the  following  topological  definition. 

Definition  4:  The  property  II  is  well-posed  at  p  e  l'0  (the  complement  of 
10  if  II  also  holds  in  a  sufficiently  small  neighborhood 
of  p. 

Lemma  1:  The  set  S  of  points  where  a  generic  property  is  well-posed 
is  open  and  dense.  Moreover,  the  Lebesgue  measure  of  SC 
is  zero. 

The  proof  of  Lemma  1  is  routine  and  is  omitted.  It  is  easy  to  see 
that  a  point  p  where  a  generic  property  holds  is  well-posed  but  that  the 
converse  is  not  necessarily  true. 

We  now  have  sufficient  framework  to  make  a  formal  definition  of 
robustness. 

Definition  5:  Given  a  point  p  with  generic  property  II  (generic  with 

respect  to  some  proper  variety  V)  well-posed  at  p,  let 

d  =  min  ||  p  -  v  ||  . 
vet/ 

We  say  II  is  robust  at  p  if  d  is  "large". 

The  number  d  is  frequently  difficult  to  compute  or  estimate.  When 
it  can  be  determined,  it  gives  valuable  information  about  how  much 
perturbation  or  uncertainty  can  be  tolerated  at  p.  For  the  situation 
of  special  interest  in  this  paper, Example  2  below,  we  shall  see  that 
d  can  be  explicitly  calculated,  at  least  theoretically.  We  now  illustrate 
the  above  concepts  with  two  examples. 
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Exanple  1 

nils  example  is  chosen  from  Wonham  [2]  who  uses  the  concepts  of 
genericity  and  well-posedness  in  nontrivial  ways  for  a  variety  of  control- 
theoretic  problems.  In  this  trivial  example,  we  seek  solutions  of  the 
system  of  linear  equations 


Ax  -  b 

where  A  e  IR10*0  (i.e.,  A  is  an  mxn  matrix  with  real  coefficients)  and  b  e  IRm. 
Our  parameter  vector  is  p  where 

pT  -  (aL1#  •  •  •  #  V*  bx . bm>  e»N*  N  =  mn  +  m 


(  denotes  transpose) .  II  is  the  property  of  the  equation  having  a  solution 
which  is  equivalent,  of  course,  to  the  statements  that  b  6  Im  A  or 
rk[A,  b]  »  rk  A.  For  example,  if  A  *  1  „  „  J  and  b  =1.^1  then 


C  3  -  *  -ft) 


H(l, 2, 2,4;  bx,b2) 


0  if  b 2  ?  2b1 


1  if  b„ 


2b, 


It  is  then  easy  to  show  the  following:  (see  [2]) 


1.  II  is  generic  if  and  only  if  m  <_n. 

2.  II  is  well-posed  at  p  if  and  only  if  rk  A  -  m. 


Example  2 

this  example  is  similar  to  Example  1  in  the  special  case  m  -  n.  We 

are  given  a  nonsingular  matrix  A  €  TRnxn  and  we  are  concerned  with  the 

T 

nearness  of  A  to  singularity.  Identifying  A  with  p  -  (a^,...,  a^, 
*21'...,  *nn*  define  the  property  II  by 
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10  if  p  represents  a  singular  matrix 
1  if  p  represents  a  nonsingular  matrix  . 

Then  it  is  easy  to  see  that  II  is  a  generic  property  and  well-posed  where 
it  holds.  This  is  the  precise  statement  that  "almost  all  nxn  matrices 
are  nonsingular".  Formally  writing  down  the  determinant  of  A  as  a  poly¬ 
nomial  in  a^,...,  a^  defines  the  necessary  variety  V.  It  turns  out, 
in  a  theorem  attributed  by  Kahan  [3]  to  Gastinel,  that  the  distance  d 
from  a  point  p  e  V°  to  \)  can  be  explicitly  determined. 

Theorem  1:  A  nonsingular  matrix  A  differs  from  a  singular  matrix  by  no 
more  in  norm  them  — i-— ,  i.e.,  given  A, 

rhi 


— — r —  *  mint  II E  [I  :  A  +  E  is  singular)  . 

Thus  d  «  — — ^ —  and  we  might  say  that  A  is  robust  with  respect  to 

invertibility  if  d  is  "large".  To  avoid  certain  scaling  difficulties, 
it  may  be  more  desirable  to  work  with  a  relative  measure  of  distance, 

rel 

d  ,  defined  by 


i&n  •  n a- hi  ’ KM 


The  quantity  k(A)  is  recognizable  as  the  condition  number  of  A  with 
respect  to  inversion.  Of  course,  all  the  above  quantities  depend  on  the 
particular  matrix  norm  used.  To  exhibit  the  specific  dependence  on  the 
norm  ||  •  || ^  we  shall  append  a  subscript  "q".  For  example. 


Let  A  have  singular  value  decomposition  A  =  USV  where  U,  V  6  ]R 


where  R  ■  diag{0 


Then  the 


for  the  k —  column  which  consists  of  the  elements 


In  fact,  letting  z  ■  sgn 


with  the  only 


f  A-1z  is  l  lOfcjl  =  IIa"L!L»o  that  uTa_1z  =  1. 

j-1 

) A  is  singular.  Moreover,  the  singular  direction  is 


Hence  A  +  E 


given  by  A  z  since  (A+E) A  z  =  0 


The  results  for  this  norm  are 


then  the  minimizing  E  is  given  by  E 


we  shall  see  in  Section  3  how  the  results  in  Example  2  can  be  applied 


in  studying  robustness  of  stability  of  linear  systems 


In  this  section  we  shall  provide  a  brief  introduction  to  both  the 


of  feedback.  This  will  serve  a  two-fold  purpose:  first,  to  set  the  svage 


notation,  especially  for  non-engineers.  This  material  is  standard  and 


He  shall  consider  modelling  physical  systems  by  models  which  take 


Starting  from  the  initial  condition  x(0)  the  solution  of  (1)  is 


well-known  to  be 
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Denoting  (one-sided)  Laplace  transforms  by  upper  case  letters,  take 
Laplace  transforms  in  (4)  to  get 

Y(s)  =  CX (s)  =  C(sl  -  A)-1x(0)  +  C(sl  -  A) _1BU (s)  .  (5) 

The  matrix  G(s):  ■  C(sl  -  A)  is  called  the  transfer  matrix.  Notice 
that  G(s)  is  the  Laplace  transform  of  the  impulse  response  matrix. 

As  will  be  seen  in  the  sequel,  it  is  of  interest  to  study  the 
response  of  the  above  linear  system  to  sinusoidal  inputs  of  the  form 

u(t)  ■  e-^v,  t  0  (6) 

where  v  is  a  constant  m-vector,  to  is  the  frequency  of  the  sinusoidal 
input,  and  j  **  /-l.  The  response  of  (1)  to  this  input  can  then  be 
shown  to  be  of  the  form 

x (t)  -  etAa  +  (jtol- A)"1Bvej<^t,  t  >  0  (7) 
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Tuming  now  to  the  case  of  a  real  signal  given  by 


u^t)  *  vksin(a»t  +  •  t  >_  0 

uA(t)  *  0,  i  =  1, . . . ,  m;  i  f  k. 


(10) 


we  have  steady-state  frequency  response  of  the  &th  output  given  by 

y^(t)  -  (c^tjcoilVk  sin  (cot  +  <J>k  +  iplk)  (11) 

where  ^  *  arg  (G^  ( jto) )  . 

Aside  from  its  obvious  importance  in  the  above  analysis,  the 
frequency  response  matrix  is  important  for  two  reasons: 


1.  Sinusoidal  signals  are  readily  available  as  test  signals 

for  a  linear  system  so  G(jcu)  can  be  experimentally  determined. 

2.  Various  plots  or  graphs  associated  with  G(jo>)  can  be  used  to 
analyze  control  systems,  for  example,  with  respect  to  stability. 
Plots  such  as  those  associated  with  the  names  of  Bode,  Nichols, 
and  Nyquist  are  essentially  different  ways  of  graphically 
representing  (Gj^tjco)  |  and  arg(G^k  ( jco) )  as  functions  of 

(o.  These  plots  are  used  extensively  in  the  analysis  of 
single-input  single-output  control  systems  where  the  robust¬ 
ness  of  stability,  e.g.,  the  amount  of  gain  and  phase  margin 
available,  is  checked  essentially  visually.  The  appropriate 
techniques  in  the  multiple-input  multiple-output  case  are 
still  being  investigated  and  part  of  the  motivation  for  the 
research  in  [1]  and  this  paper  is  directed  towards  this  end. 
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Turning  now  to  the  notion  of  feedback  whose  essential  idea  is  to 
allow  for  stability  of  a  system  in  the  face  of  uncertainty  (noise, 
model  error,  etc.),  the  diagram  below  illustrates  the  basic  (unity) 
feedback  control  system: 


Fig.  1.  Basic  Feedback  Control  System 

Here  u  is  a  reference  input,  y  is  the  output,  and  e  »  u  -  y  is  the  error 
or  difference  between  the  reference  input  and  the  output  which  we  wish 
to  be, ideally,  zero.  The  plant,  compensators,  actuators,  and  sensors 
sure  all  represented  by  G.  There  are  much  more  elaborate  and  detailed 
feedback  structures  than  that  described  above  and  the  structure  can  be 
studied  in  a  considerably  more  general  function-space  setting  (see  [4] , 
for  example)  than  the  simple  linear  causal  time-invariant  setting  we 
shall  consider.  However,  the  simple  system  is  adequate  to  exhibit  most 

of  the  key  ideas  in  this  paper.  Now,  in  this  system  we  have 

1 

e*u-y  =  u-  Ge  (12) 

/ 


The  quantity  I  +  G  is  called  the  return  difference  matrix.  As  in  [1] 


the  matrix  G(j&))  then  provides  sufficient  data,  via  the  Nyquist  criterion, 
to  test  for  stability  of  the  closed- loop  system.  Henceforth,  we  shall 
assume  that  our  nominal  feedback  system  above  is  stable  in  which  case 
HG  is  invertible.  Then  from  (13)  we  have 

e  -  (I  +  G)  ^u  (14) 


so  that 


y  =  Ge  =  G(I  +  G)_1u  .  (15) 

In  (15),  the  quantity  G(s) (I  +  G(s))  1  is  called  the  closed-loop  transfer 

matrix  while  G(jco)  (I  +  G(  jto) )  *  is  called  the  closed-loop  frequency  | 

response  matrix.  We  then  pose  the  basic  stability  questions 

Does  the  nominal  feedback  system  remain  stable  when  subjected 
to  perturbations  and  how  large  can  those  perturbations  be? 

Let  us  observe  at  this  point  that  there  is  nothing  sacred  about 
linearity  in  the  above  discussion  and  more  general  nonlinear  treat¬ 
ments  can  be  found  in  [4]  and  [5],  for  example.  The  question  of  "near-  1  j 

ness  to  singularity"  of  (I  +  G),  even  in  the  nonlinear  case,  is  naturally 

I  j 

intimately  related  to  a  notion  of  condition  number  for  nonlinear 

i 

equations.  The  interested  reader  could  readily  adapt  the  ideas  of 
Kheinboldt  [6]  to  the  particular  application  at  hand  here. 

I 


- - — . 
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3.  BASIC  STABILITY  RESULTS  AND  RELATED  TOPICS 

a.  ADDITIVE  AND  MULTIPLICATIVE  PERTURBATIONS 

we  shall  consider  two  fundamental  types  of  perturbations  in  the 
basic  feedback  system  of  Fig.  1.  Throughout  this  section,  ]j  •  ||  will 
denote  any  matrix  norm  with  ||  I  ||  =  1.  The  first  case  to  be  considered 
is  the  case  of  additive  perturbations  to  G,  pictured  below: 


Fig.  2.  Additive  Perturbations 

In  other  words,  the  nominal  G  is  perturbed  to  G  +  L.  Under  the  assumptions 
that  both  the  nominal  closed-loop  system  and  the  perturbation  L  are 
stable  it  can  be  seen  from  the  Nyquist  criterion  and  the  identity 

I  +  G  +  L  =  (I  +  G)  [I  +  (I  +  G)_1L]  (16) 

that  the  perturbed  closed-loop  system  remains  stable  if 

||(I  +  G(jai))"lL(j(o)  ||  <1,  ai  >  0  (17) 

A  weaker  condition  them  (17)  but  one  which  directly  exposes  L  is 
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||L<ja>)  l|  <  - - - - - ,  to  >  0  (18) 

|1<I  +  G  ( ja» ) _A  || 

The  second  case  to  be  considered  is  that  of  multiplicative  perturba¬ 
tions: 


Fig.  3.  Multiplicative  Perturbations 

In  this  case,  the  nominal  G  is  perturbed  to  G(I  +  L).  Under  the  assumptions 
that  both  the  nominal  closed-loop  system  and  the  perturbation  L  are 
stable  it  can  be  shown  from  the  Nyquist  criterion  and  the  identity 

I  +  G(I+L)  =  (I  +  G)  [I  +  (I  +  G-1)_1L]  (19) 

that  the  perturbed  closed-loop  system  remains  stable  if 

||(I  +  G"1(j«#))“1t(jo»)||  <1,  <o  >  0  (20) 

(assuming  G  exists).  Again,  a  weaker  condition  than  (20)  but  one 
which  directly  exposes  L  is 

||l  (jtt)  II  <  - - ^ - Z7—  ,  0)  >  0  .  (21) 

||(I  +  G  A(j0>))  L\\ 

'  'V- - I _  |  •  M  •- _ 
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Remark  l»  As  we  noted  in  Section  1,  the  above  inequalities  are  tight, 
i.e.,  the  <  cannot  be  replaced  with  . 

Remark  2;  Where  convenient  we  shall  henceforth  drop  the  "jto"  arguments . 
Remark  3:  It  must  be  stressed  that  the  results  based  on 

||(I+G±V1||  ||l.  ||  <  1  (18),  (21) 

are  weaker  than  those  based  on 

|{(I  +  G±L)  ”^L  ||  <  1  (17),  (20) 

since 


±1  ,  . 

For  exang>le,  if  L  ■  c(t  +  G  )  for  some  constant  c,  |c|  <  1,  the 
differences  in  the  bounds  are  obvious.  In  (18),  (21)  we  have 

||(i  +  g±V1||  •  IUII  •  lel-KU  *atl) 

while  in  (17) ,  (20)  we  have 

||(i*g±V1l||  -  |c| 

and  it  is  possible  to  have 

|c|  «  |c  |  •  K  (I  +  G±X)  . 

However,  for  random  perturbations  L,  (22)  is  often  approximately  an 
equality.  To  see  this,  note  that  a  random  (dense)  L  will  almost  surely 
be  invertible;  recall  Example  2.  It  is  then  easy  to  show  that 


Again,  since  L  is  random,  it  will  almost  surely  be  well-conditioned 
(w.r.t.  inversion)  so  that  ||l  *11  **  p][[~  •  Hence, 

||(I  +  G±1)'1L||  *  II (i  +  g±1)’1||*  ||l||  . 

A  related  aspect,  also  worth  noting,  follows  from  the  inequalities 

J|tt*  ilL:  IU  II  <  [|(I  +  G±1)-1L||  <  lld*Gil)-1||  •  ||  L  ||  . 
K(I  +  G  ) 

±1  +1 
If  (I  +  G  )  is  reasonably  well-conditioned  (<{I  +  G  )  near  1)  ,  the 

majorization  (22)  will  not  be  a  bad  overestimate. 


Remark  4:  By  our  discussion  in  Section  1, 

X 


stability  robustness  is 


the  appropriate  measure  of 


d  -  min - - - r - .  (23) 

a»0  ||(I  +  G~  ( ja>) )  ~  || 

and  in  the  sequel  we  shall  consider  methods  of  efficiently  plotting 
- — : —  as  a  function  of  a).  This  quantity  is  familiar  from 

IKi+ Sh -'ii 

classical  sensitivity  analysis  where  it  is  shown,  in  the  single-input 
single-output  case,  that  the  change  in  the  output  of  a  closed-loop 
system,  due  to  (additive)  perturbations  in  G  (scalar) ,  is  reduced  by 
a  factor  of  1  +  G  compared  with  the  open-loop  effect. 

Remark  5»  So  far  we  have  required  nothing  of  our  norm  other  than 


||  I  ||  ■  1.  Of  course,  a  frequently  occurring  norm  in  much  of  the 
analysis  of  linear  systems  is  the  spectral  norm  ||»  .  in  that  case 
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1  +1 
- tt — s —  is  the  smallest  singular  value  of  (1  +  G  ) .  Let 

(I  to*1)'1  II 


dqto) 


r1(joj))'1||q 


We  are  interested  in  plotting  d^(to)  versus  0)  for  large  numbers  of 

u's.  We  shall  see  in  the  sequel  that  determining  d^  (to)  cam  be 

somewhat  more  expensive  to  determine  than,  say  d, (to)  or  d  (to).  More- 

1  00 

over,  note  that 


-£-11 * IL  I  II »  IL  <  Ji  II  a 

✓m 


£z  (All,  I  ||»IL<  «  ll»l|, 


for  A  6  l™™.  Since  we  are  usually  most  interested  in  order-of-magnitude 

estimates  of  d  (to) ,  d„ (to)  will  lie  in  a  strip  sufficiently  close  to 
q  2 

d^ (to) ,  for  example ,  to  give  the  same  qualitative  information .  The 
number  m  which  is  the  number  of  inputs/outputs  in  the  system  is  typically 
no  more  than  about  10  and  is  frequently  much  less. 


b.  RELATIONSHIPS  BETWEEN  ADDITIVE  AND  MULTIPLICATIVE  PERTURBATIONS 

The  following  theorem  relates  additive  and  multiplicative  perturba¬ 
tions.  Again,  the  "jto's"  will  be  omitted  for  convenience  and  all 
relations  will  be  assumed  to  hold  for  all  to  >  0. 


with  singular  values  0(H)  >  ...>  0  (H)  >  0  we  note 


while  (29)  becomes 


We  shall  make  great  use  in  the  sequel  of  the  following  result 


,nxn 


Then 


(A+B)  <  O,  (A)  +  0  .  (B)  ;  i  >  1,  j  >  1 


Proof;  Follows  immediately  from  Theorem  3  using 
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For  the  rest  of  this  subsection  we  shall  let  H  denote  either 
I  +  G  or  I  +  G  1  according  to  whether  additive  or  multiplicative 
perturbations  are  appropriate.  The  next  theorem  will  show  how  the 
singular  values  of  H  +  L  can  be  bounded  in  terms  of  ||  L  ||2  and  the 
singular  values  of  H. 


Theorem  5:  Suppose  <7k(H)  ak  >  0  for  some  k#  1  5.  *  £.  m' 

||  L  <_  8.  Suppose  further  that  8  <  a^.  Then: 

(a)  o  (I  +  H-1L)  >  1  -  -f- 

K  He 

(b)  0k  (H  +  L)  >_  01^  -  8  . 

(Note:  If  k  f  m,  H  +  L  is  not  necessarily  invertible  if  8  is  too  large.) 

Proof:  (a)  Use  1  =  1  +  H_1L  -  h’1!,  and  A  *  I  +  H-1L,  B  «  -H  1L,  i  =  k, 

j  ■  m-k  +  1  in  Theorem  3(a)  to  get 

a  (I)  <0.(1  +  H*  ^  +  0  (H-1L)  . 

m  #c  iu"Kti 

Thus  0.(1  +  H_1L)  >  1  -  0  (H-1L) 

K  —  m-K+j. 

•>  1  -  ||  L  11^  *  by  Theorem  3(b) 

-  1  -  II L  ll2ak(H) 


(b)  Use  H  =  H  +  L  -  L  and  A  =  H+  L,  B  -  -L,  i  *  k,  j  «  1 
in  Theorem  3(a)  to  get 

ak(H+L)  >ak(H)  -  IUHj  >  ak  -  8  . 


_ 
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The  case  k  *  m  is  of  special  interest  in  Theorem  5  as  it  bears 
directly  on  our  two  basic  inequalities  (18)  and  (21)  of  the  form 


which  are  sufficient  to  guarantee  stability  of  a  perturbed  closed-loop 
system.  Specifically,  if  II  H  ^"ll  2  1  a  and  II L  II  ±  3  with  0  ^  3  <  a, 
then  H+L  is  invertible  and  ||(H+L)  ^ ||  <  ^-or  a^tH+L)  >_  a  -  3. 

Note  that  Theorem  5  was  expressed  in  terms  of  isolating  ||  L  ||2  -  By 
analogy  with  the  inequalities  (17)  and  (20)  we  can  also  have  the  fol¬ 
lowing  stronger,  but  perhaps  less  useful,  theorem. 


Theorem  6:  Suppose  am_k+1  *L)  ^  1  -  <5  where  0  <  6  <  1  and  1  k  £  m 
Then: 

(a)  ak(I  +  H-1L)  >_  5 

(b)  a.  (h  +  l)  >  — £r- 

k  "  I|h~  1 II 2 


Proof:  (a)  From  the  proof  of  Theorem  5  we  have 

0Jt(I+H"1L)  >  1  -  °m_k+1(H~1L)  1  <5 

(b)  From  I  +  H  ^L  =  H  1  (H  +  L)  and  Theorem  3(b)  we  have 
ak(i  +  h\)  <Ok(H  +  L)  •  || h"1  || 2 

whence  a,  (H+L)  >  v  ■  -  . 


a.  SPECIAL  RESULTS  WHEW  G(s)  «  C(sl  -  A^B 


In  this  subsection  we  shall  make  use  of  the  fact  that  the  frequency 
response  matrix  is  of  the  form 

G(j<o)  -  C(jcoI  -  A)_1B 
Let  us  further  define 

F(j<o)  -  C(jO)I  -  A  +  BC)-1B  (30) 

Recall  the  Sherman-Morrison-Woodbury  formula: 

(W  +  XY2)"1  =  W_1  -  W~1X(Y~1  +  ZvT'So^Zvf 1 
assuming  the  indicated  inverses  exist.  Then  it  is  easy  to  verify  that 
(I  +  Gtjtt))"1  =  I  -  F(jto)  (31) 


and,  from  (27) , 


(I  +  G_1  ( jco)  )_1  =  F(jco) 


(32) 


Thus  our  results  in  the  last  section  (for  example,  Theorems  4,  5, 
and  6)  can  all  be  cast  in  terms  of  F  by  noting  that 


V1  *  01  ’  a 


m-k+1 


(I-F) 


(33) 


and 


a  (i  +  g"1)  -  - 
k  a 


m-k+1 


(F) 


(34) 


Moreover, 
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and 

||(I+ G"1)"1 1|  =  ||  7  ||  (36) 

for  any  of  the  norms  we  have  been  considering  (in  particular,  k  *  m  in 
(33)  and  (34)).  Use  of  (31)  and  (32)  results  in  am  apparent  savings 
in  the  number  of  linear  systems  to  be  solved  (i.e.,  number  of  inversions) 
and  we  shall  exploit  this  fact  in  the  next  section. 
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4.  COMPUTATIONAL  PROBLEMS 

a.  COMPUTATION  OF  FREQUENCY  RESPONSE  MATRICES 

As  we  have  seen  above,  an  object  of  considerable  interest  in  studying 

the  robustness  of  stability  of  linear  systems  is  a  graph  of  - - r 

||(I  ♦  G_1(jW))‘1|| 

as  a  function  of  0).  When  G(jcu)  =  C(jcoI  -  A)  1B  we  saw  that  ||(I  +  G  ( j«o) )  1 1|  * 
||l-F(jco)||  and  || (I  +  G  1  ( joi) )  »  ||f  ( jco)  ||  where  F  ( jco)  *  C(jo)I  -  A  +  BC)  1B. 

Thus,  regardless  of  the  norm  used,  a  quantity  of  the  form 

C(j(oI  -  H)-1B  (37) 

must  first  be  computed.  We  shall  assume  throughout  this  and  the  next  sub¬ 
section  that:  (i)  B  e  IRnXm,  C  eiR™'30',  H  e  ®.nXn  are  given 
(ii)  n  >  m 

(iii)  (37)  is  to  be  evaluated  for  a  large  number,  N,  of 
values  of  0);  typically  N  >>  n. 

Rather  than  concentrate  on  exact  operation  counts,  which  may  be  fairly 
meaningless  anyway,  we  shall  give  only  order-of-magnitude  estimates. 

It  will  be  seen  that  the  bulk  of  the  computational  load  rests  on  evalu¬ 
ating  matrices  of  the  form  (37)  and  so  we  shall  focus  initially  on 
that  problem. 

nxn  -1 

If  A  e 3R  is  dense,  the  most  efficient  evaluation  of  C(jul  -  A)  B 

by  an  LU  factorization  of  A,  solution  of  m  triangular  systems  to  get 

(jwl  -  A)  B,  and  finally  a  matrix  multiplication,  requires  approximately 

13  12  2 

— n  +  jmn  +  m  n  multiplications  (and  a  like  number  of  additions;  we 
shall  henceforth  count  only  multiplications).  This  figure,  when  multiplied 
by  N,  represents  a  rather  large  amount  of  computation. 


If  A  is  initially  transformed,  however,  the  computational  burden 
can  be  reduced  quite  considerably .  If  T  is  a  similarity  transformation 
on  A  we  have 

C(jC0l  -  A)_1B  =  CT'.jCOI  -  T~1AT)-1T~1B  . 

Let  us  define 

H  =  T_1AT 

and  agree,  for  convenience  to  still  label  CT,  T  ^B  the  transformed  C  and 
B  matrices,  respectively,  as  C,  B  respectively.  We  now  have  the  problem 
of  evaluating 

C(j<oI  -  H)~1B 

where  H  may  now  be  in  such  a  form  that  (jwi-  H)  *  can  be  computed  in 

less  them  0(n3)  operations.  For  example,  A  can  always  be  reduced  to 

5  3 

upper  Hessenberg  form  by  (stabilized)  elementary  trains  formations  (—  n 

6 

multiplications)  or  by  orthogonal  transformations  (j  n3  multiplications) . 

These  transformations  are  very  stable  numerically  and,  while  0(n3),  are 

performed  only  once  at  the  beginning  of  the  calculations.  The  resulting 

linear  system  to  be  solved  -  for  N  different  values  of  oj  —  now  has  an 

upper  Hessenberg  coefficient  matrix  and  can  be  solved  in  approximately 
1  2 

—  mn  multiplications.  Moreover,  Hessenberg  systems  can  be  solved  very 

accurately  with  the  growth  factor  in  Gaussian  elimination  bounded  above 

by  n;  see  [8],  Computing  C(jcoI  -  H)  ^B  still  requires  an  additional 
2 

m  n  multiplications.  Neglecting  the  initial  transformation  and  deter¬ 
mination  of  CT  and  T  ^B,  the  Hessenberg  method  requires  approximately 
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12  2 

—  mn  +  m  n  multiplications  (for  each  value  of  co),  a  considerable  savings 

3 

over  the  0(n  )  algorithm  if  n  »  m. 

Of  course,  other  trams formations  T  are  possible.  One  possibility  is 
to  reduce  A  to  upper  triangular  (Schur)  form  by  means  of  orthogonal  simi¬ 
larities.  This  is  considerably  more  expensive  than  reduction  to  upper 
Hessenberg  but,  again,  need  only  be  done  once  at  the  beginning.  How¬ 
ever,  the  resulting  linear  system  to  be  solved  at  each  step  is  upper 

2 

triangular  and  so  still  requires  0(mn  )  multiplications.  Because  of 

potential  difficulties  with  multiple  eigenvalues  of  A  there  seems  to  be 

little  real  advantage  gained  by  this  procedure.  Substantial  savings 

could  be  gained  though  if  the  eigenstructure  of  A  were  such  that  it 

was  diagonalizable  by  a  reliably  computable  T.  Since  this  involves 

consideration  of  the  essentially  open  numerical  problems  associated  with 

computing  invariant  subspaces  we  shall  not  pursue  the  details  here. 

But  assuming  such  a  transformation  were  possible,  C(jo>I  -  D)  with 

2 

D  diagonal,  could  be  computed  with  approximately  mn  +  m  n  multiplications 
for  each  value  of  c o.  Attractive  as  this  appears,  the  potential  for  severe 
ill-conditioning  of  the  eigenproblem  associated  with  A  render  this  latter 
method  unreliable  as  a  general-purpose  approach.  We  shall  subsequently 
consider  only  the  Hessenberg  method. 

The  analysis  above  has  been  done  under  the  assignation  that  complex 
arithmetic  was  performed.  We  now  outline  how  G  -  C( jwl  -  H)  * B  might 
be  determined  using  only  real  arithmetic.  The  matrix  H  is  assumed  to 
be  in  upper  Hessenberg  form.  We  wish  to  solve  first 

(jtol  -  H)Z  -  B  (38) 


- 

) 
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Then 

G  =  CZ  . 

Suppose  Z  »  X  +  jY  where  X,  Y  euf130".  Upon  equating  real  and  imaginary 
parts  in  (38)  we  get  the  following  order  2n  real  system  to  determine 
X  and  Y: 


(" 

m  1 

03 


-031 


-H 


(39) 


2  2 

invertible  if  (jtol  -  H)  is  invertible-  Note  that  (o)  I  +  H  )  is  no  longer 
upper  Hessenberg  but  is  almost  in  the  sense  of  having  two  rather  than  one 
nonzero  subdiagonal.  Its  shape  is  wholly  typified  for  n  =  5  by  the 
matrix 


Linear  systems  involving  matrices  of  this  type  can  be  solved  using 
2 

approximately  n  multiplications.  We  summarize  the  Hessenberg  method 
using  real  arithmetic: 


(i)  Reduce  A  to  upper  Hessenberg  form  H,  transform  B  and  C, 
2 

and  compute  H  ;  this  step  is  done  only  once. 


—  ... 
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2  2 

(ii)  Solve  (co  1  +  H  )Y  =  -a)B  for  Y. 

(iii)  Compute  X  «  —  HY  . 

co 

(iv)  Compute  G  =  (CX)  +  j (CY)  . 

2 

Step  (ii)  requires  approximately  mn  multiplications,  step  (iii)  requires 

12  2 
approximately  —  mn  ,  and  step  (iii)  approximately  m  n.  The  total  number 

3  2  2 

of  multiplications  is  approximately  j  ran  +  m  n. 

Storage  requirements  for  the  Hessenberg  method  with  real  arithmetic 
are  approximately  double  those  for  complex  arithmetic. 

b.  COMPUTATION  OF  ROBUSTNESS  MEASURES 

We  have  seen  above  that  quantities  of  the  form  (37)  can  be  reliably 
2 

evaluated  in  0(mn  )  operations.  There  then  remains  the  problem  of 
determining  (35)  or  (36). 

Case  1:  ||  •  ||2 

For  (35),  the  singular  value  decomposition  (SVD)  of  I  +  G(jci))  can 
be  computed  for  each  value  of  «.  Each  SVD  typically  requires  approximately 
6m3  multiplications.  The  smallest  singular  value  is  then  the  quantity  of 
interest.  For  (36),  inversion  of  G  can  be  avoided  by  finding  the  SVD 
of  F(j(o),  again  in  approximately  6m3  multiplications.  The  inverse  of 
the  largest  singular  value  of  F  is  then  the  quantity  of  interest. 

Cwe  2:  ||  •  ||x  or  ||  •  ||  ^ 

Use  of  either  of  these  norms  in  (35)  or  (36)  involves  negligible 

2 

computation  as  compared  to  Case  1,  namely  about  m  additions  and  absolute 
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values  and  m-1  arithmetic  comparisons. 

In  both  cases ,  the  additional  work  required  is  usually  small  compared 
2 

with  0(mn  )  especially  if  n  >>  m.  However,  if  m  is  large  relative  to 
n,  significant  savings  can  be  realized  in  using  ||»  H^or  ||- 1^  rather  than 
||  •  l^ •  In  fact,  using  our  previous  approximate  operation  counts  for 
the  Hessenberg  method  and  setting  n  =  km,  we  have 


work  per  value  of  a)  using  *  |  -  2 

p  s  _  1  2 _ -  k  +  2k  +  12 

work  per  value  of  w  using  ||  •  ||  or  ||  •  |^  k2  +  2k 

2 

3c  +  2)c  +  24 

Note  though  that  p  ~  - = -  if  singular  directions  are  also  com- 

k  +  2k 

puted. 

In  the  event  A  (or  A  -  BC)  can  be  successfully  diagonalized  as 
mentioned  in  Section  4. a.  the  potential  savings  in  avoiding  ||  •  ||2  are 
somewhat  greater.  In  fact,  we  then  have 


(or  p  a  — £ —  if  singular  directions  are  also  computed)  . 

The  above  comparisons  are  only  approximate  and  should  in  no  way 
be  construed  as  definitive  statements.  The  purpose  of  this  section  is 
to  merely  introduce  certain  aspects  of  the  numerical  computations  and 
suggest  further  avenues  of  exploration.  A  great  deal  of  numerical 
experimentation  remains  to  be  done.  Reliable  software  such  as  LINPACK 
[9]  for  linear  systems  will  be  of  great  benefit  in  this  research. 


I 


i. -•  ...  ~  m  _ ' 


5.  CONCLUSIONS 


We  began  this  paper  with  an  attempt  at  a  ’’formal”  definition  of 

robustness.  We  then  applied  the  definition  to  the  problem  of  robustness 

of  stability  of  linear  systems  as  discussed  in  [1] .  The  cases  of  both 

additive  and  multiplicative  perturbations  were  discussed  and  a  number  of 

relationships  between  the  two  cases  were  given.  Finally,  a  number  of 

computational  aspects  of  the  theory  were  discussed  including  a  proposed 

new  method  for  evaluating  general  transfer  or  frequency  response  matrices 

The  new  method  is  numerically  stable  and  efficient,  requiring  only 
2 

0(mn  )  operations  to  update  for  new  values  of  the  frequency  parameter 
rather  than  0(n3) 

A  number  of  interesting  research  areas  suggest  themselves  in  this 
work.  One  such  area  is  that  of  constrained  perturbations.  For  example, 
in  our  basic  problem  we  were  concerned  with  the  nearness  to  singularity 
of  a  nonsingular  matrix  A  e  (CnXn.  If  the  admissible  perturbations  E 
are  somehow  constrained  for  one  reason  or  another,  for  example  E  upper 
triangular,  the  usual  bound  on  jj  E  ||  for  which  A  +  E  is  singular  but  E 
is  "dense"  may  be  overly  pessimistic.  Related  to  this  is  the  fact  that 
our  bounds  were  derived  for  the  "worst  case".  The  size  of  perturbations 
allowed  in  a  linear  system  to  ensure  continued  closed- loop  stability  may 
very  well  be  larger  than  we  have  derived  if  inputs  to  the  system  are 
constrained  in  certain  directions. 

We  have  concentrated  in  this  paper  on  the  analysis  of  linear  control 
systems.  There  are  many  interesting  —  and  difficult  —  synthesis  problems 
however.  For  example,  can  A,  B,  C  be  chosen  to  assign  certain  singular 
values  of  I  +  G-1?  What  is  the  effect  of  changes  in  B  or  C  on  the 
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behavior  of  ,1  +  G  ?  Can  a  matrix  K  be  determined  so  that  X  +  (GK)“ 
has  certain  singular  values? 

On  the  computational  side,  more  research  needs  to  be  done  on  updating 
parametric  problems.  That  is,  suppose  we  have  a  matrix  (say,  G(j<o)) 
which  depends  "in  a  rank  m  way"  on  a  parameter  (o.  When  co  changes  how 
can  various  quantities  be  updated  efficiently? 

Finally,  as  mentioned  in  Section  4.b.,  a  great  deal  of  numerical 
experimentation  is  necessary  to  get  a  qualitative  feel  for  the  numbers 
in  determining  robustness  measures. 
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QUANTITATIVE  SYNTHESIS  OF  UNCERTAIN  MULTIPLE 
INPUT-OUTPUT  FEEDBACK  SYSTEMS 

1.  INTRODUCTION 

jk 

There  is  great  interest  in  multiple  input-output  (mi o)  feedback  systems, 
for  obvious  reasons.  A  great  deal  of  significant  work  (too  numerous  to  list 
but  Wonham  and  Morse  1972,  MacFarlane  1973,  Wang  and  Davison  1973,  Rosenbrock 
1974,  Porter  and  D'Azzo  1978  are  representative  and  include  bibliographies)  has 
been  done,  primarily  in  the  realization  and  properties  of  the  closed-loop  input- 
output  relations,  under  the  constraint  of  a  feedback  structure  around  the  known, 
fixed  mio  "plant."  There  has  been  notable  work  done  with  uncertain  inputs,  but 
again  only  with  fixed,  known  plants.  Of  course,  plant  uncertainty  is  always 
implicit,  if  only  because  of  the  usual  approximations  required  to  obtain  a  linear 
time-invariant  (iti)  model. 

In  any  case,  there  does  not  exist  as  yet  any  "quantitative  synthesis" 
technique  for  the  mio  problem  with  significant  plant  uncertainty,  even  for  the 
linear  time-invariant  case.  By  "quantitative  synthesis"  is  meant  that  there 
are  given  quantitative  bounds  on  the  plant  uncertainty,  and  quantitative 
tolerances  on  the  acceptable  closed-loop  system  response.  The  objective  is 
to  find  compensation  functions  which  guarantee  that  the  performance  tolerances 
are  satisfied  over  the  range  of  the  plant  uncertainty.  In  "quantitative 
design,"  one  guarantees  that  the  amount  of  feedback  designed  into  the  system 
is  such  as  to  obtain  the  desired  tolerances,  over  the  given  uncertainty  range. 

In  other  designs,  the  amount  of  feedback  may  be  more  or  less  than  necessary-- 
it  is  a  matter  of  chance.  The  practical  experienced  designer  may  find  the 
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ABSTRACT 

There  is  given  an  n  input,  n  output  plant  with  a  specified  range  of 
parameter  uncertainty  and  specified  tolerances  on  the  n^  system  response  to 
command  functions  and  the  n  response  to  disturbance  functions-  It  is  shown 
how  Schauder's  fixed  point  theorem  may  be  used  to  generate  a  variety  of 
synthesis  techniques,  for  a  large  class  of  such  plants.  The  design  guarantees 
the  specifications  are  satisfied  over  the  range  of  parameter  uncertainty.  An 
attractive  property  is  that  design  execution  is  that  of  successive  single¬ 
loop  designs,  with  no  interaction  between  them  and  no  iteration  necessary. 
Stability  over  the  range  of  parameter  uncertainty  is  automatically  included. 

By  an  additional  use  of  Schauder's  theorem,  these  same  synthesis 
techniques  can  be  rigorously  used  for  quantitative  design  in  the  same  sense 
as  above,  for  nxn  uncertain  nonlinear  plants,  even  nonlinear  time-varying 
plants,  in  response  to  a  finite  number  of  inputs. 
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latter  approach  sufficient.  However,  a  scientific  theory  of  feedback  should 
certainly  include  quantitative  design  techniques. 

In  this  paper  it  is  shown  how  Schauder's  fixed  point  theorem  can  be 
used  to  generate  a  variety  of  precise  quantitative  mio  synthesis  techniques 
suitable  for  various  problem  classes.  An  outstanding  feature  of  each  -synthesis 
procedure  is  that  it  consists  of  a  succession  of  direct  (no  iterations 
necessary)  single-loop  design  steps.  Furthermore,  by  a  second  use  of 
Schauder's  theorem,  the  techniques  ore  rigorously  applicable  to  quantitative 
synthesis  of  nonlinear  uncertain  mio  feedback  systems.  This  paper  concentrates 
on  existence  proofs  but  a  2  x  2  example  is  included. 


1 . 1  Preliminary  Statement  of  a  Linear  Time  Invariant  MIO  Problem 

In  Fig.  1,  P  =  [p--(s)]  is  a  n  x  n  matrix  of  the  plant  transfer  functions 

*  J 

in  the  form  of  rational  functions,  each  with  an  excess  e..  >  0  of  poles  over 

•  J 

zeros,  and  with  a  bounded  number  of  poles.  The  p .  - (s )  are  functions  of  q 

*  J 

physical  parameters,  with  m  an  ordered  real  q-tuple  sample  of  their  values. 

M  =  {m}  is  the  class  of  all  possible  parameter  combinations.  The  elements  of 
the  n  x  n  Iti  compensation  rational  transfer  function  matrices  F  =  .  .(s)] , 

'  J 

G  =  {g -  - ( s ) j  are  to  be  chosen  practical  (each  with  an  excess  of  poles  over 

*  J 


zero).  They  must  ensure  that  in  response  to  command  inputs  the  closed-loop 
transfer  function  matrix  T  =  [tuv(s)]  (of  c  =  Tr)  in  Fig.  1  where  c,  r  are  the 
n  x  1  matrices  (vectors)  of  system  outputs  and  inputs,  respectively,  satisfy 
conditions  of  the  form 


0  <  Auv(w)  s  |tuv(ju>)|  s  Buv(w),VmtM 


0) 


•it. 


— 


If  the  tuv(s)  have  no  poles  or  zeros  in  the  right  half-plane  (are  stable  and 
minimum-phase),  then  tuv(s)  is  completely  determined  by  |tuv(ja))|,  so  (1) 
suffices  (Bode  1945).  It  has  been  shown  (Horowitz  1976)  that  time-domain 
tolerances  of  the  form 

«?<t)  *  <  «j(t) 

1  dtv  l 

v  =  0,  1,  any  finite  number,  can  be  satisfied  by  means  of  tolerances 

like  (1)  on  (c( ju>)  | ,  where  c(s)  =  Jc(t).  The  writer  finds  it  much  more 
convenient  to  develop  the  synthesis  theory  in  the  frequency  domain,  and  the 
above  proves  its  sufficiency  for  time-domain  synthesis. 

This  presentation  concentrates  on  the  command  response  problem,  but  the 
same  ideas  can  be  used  to  handle  the  quantitative  disturbance  response  problem 
under  plant  uncertainty,  as  will  be  shown  in  Sec.  6.  The  constraints  on  the 
plant  and  the  specifications  are  introduced  as  needed,  in  order  to  clarify  the 
reasons  for  their  need. 


2.  DERIVATION  OF  SYNTHESIS  TECHNIQUE 


In  Fig.  1,  there  are  available  n  loop  transfer  functions  in  L  = 

(X| j (s )}  =  PG,  and  n2  f.^  in  F  for  satisfying  the  tolerances  (1)  on  the  n2 
t..j.  But  in  the  expansion  of  T  =  [t^(s))  =  (I  +  L)_1LF#  each  tab(s,m) 

(meJO  is  a  function  of  all  the  t. .(s,m)  each  uncertain,  resulting  in  very 
complicated  expressions  for  tflb  and  making  direct  quantitative  synthesis 
seemingly  impossible--at  least  so  far  unsuccessful.  The  objective  here  Is 
to  convert  each  tab(s,m)  design  problem  into  an  equivalent  single-loop  problem 
with  uncertainty.  This  is  done  for  each  tflb,  by  lumping  all  the  other  Inter- 


acting  t..  variables  into  an  'equivalent  disturbance',  as  follows. 

•  J 

In  Fig.  1,  c  =  PG(Fr  -  c),  so 

(P_1  +  G)c  =  GFr.  (2) 

Hence,  the  following  restriction  on  P: 

(PI):  a(s)  =  determinant  P(s)  |  O.VmeM. 

Let  r  f  0  and  r.  =  0,  i  i  v,  so  the  resulting  c - (s)  =  t.  (s)r  .  Let 

*  .  •  J  * 

P'1  *  [P^U)].  (3) 

The  uth  element  of  (2)  is  then 
n 

r  (s)  V  (P  .  +  g  .)t.  =  y  g  -f.  . 
vx  '  1  ui  Jur  iv  <■  aui  iv 


To  simplify  the  presentation,  we  take  gy.  =  0  for  u  f  i  (although  in  practice 
it  may  be  useful  not  to  do  so).  Then  letting  ry(s)  =  1,  the  last  equation  can 
be  written  as 


uu 


a  f 
auu  uv 


uv 

» 

UU  A 


UV 


1  + 


'UU 


Tuv  "  Tduvduv 


d  =  y  P  .t. 

uv  .Ju  ui  i 


uu 
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(4a) 

(4b) 


This  corresponds  precisely  to  the  single-loop  problem  of  Fig.  2,  with 

D  =  1/P  .  Of  course,  the  t.  in  d  of  (4b)  are  not  known  but  the  bounds 
Kuve  uu  iv  uv 

(1)  on  |tjy|  are  known^ generating  a  set  Duv  =  {duv}.  We  define  the  extreme  duv 


SUPy 
M  i/u 


|Pu1l|B1vl.  Bjv  of  (1) 


(5) 
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Suppose  we  can  find  9uu(s)  and  fuv(s) .  such  that  in  the  notation  of  (4,5) 

0  iTuvl  4  lTduv"duve|e  [Auv*  Buv]^meM  .  (6) 

Then  the  magnitude  of  the  right  side  of  (4a)  e[Auy,  Ruy]  for  all  meM  and  for 
all  possible  combinations  of  t^y  (i  f  u)  which  satisfy  (1).  Suppose  this  is  so 

V  u,v  combinations,  and  the  other  Schauder  conditions  of  Sec.  2.1  are 
satisfied.  Then  Schauder' s  fixed  point  theorem  can  be  used  to  prove  that 

O 

these  same  n  guu  and  n  f.y  are  a  solution  to  the  synthesis  problem  (1). 

2.1  Application  of  Schauder 's  Fixed  Point  Theorem 

This  theorem  states  that  a  continuous  mapping  of  a  convex,  compact  set  of 
a  Banach  space  into  itself,  has  a  fixed  point  (Kantorovich  and  Akilov  1964). 

O 

We  define  the  Banach  space  to  be  the  n  C[0,°°]  product  space  denoted  here  by 

C(n  ),  with  norm  =  £  individual  sup  norms.  C [0 is  the  Banach  space  of  real 

continuous  functions  f(u>),  we[0H  with  ||f||  =  sup  |f(w)|.  The  convex  compact 

2  u> 

set  in  each  of  the  n  C[0,®]  is  taken  as  the  acceptable  set  of  | tuv ( joi) |  satis¬ 
fying  (1),  denoted  by  {he(w)}  =  Huy.  Additional  constraints  have  to  be  assigned 
to  the  h£  (u>)  in  order  that  each  Huy  set  is  compact  and  convex  in  C(0,®].  These 
constraints  have  been  justified  in  detail  in  (Horowitz  1975)  and  are  therefore 
only  summarized  here.  If  each  set  is  convex  and  compact  in  C[0,®],  their  n^ 

p  p 

product  set  denoted  by  H(n  )  is  convex  and  compact  in  C(n£). 

Constraints  on  Huv  «  (h(<u)?  uv 

1.3  continuous  functions  Auv(w),  Buy(w)  with  properties  of  (1)  as 
bounds  on  h(u) 

2.  h'(w)  is  uniformly  bounded:  3  5  )h'(w)|  <K,  V  h,w 


3.  h(w)-K)  as  ur+°°  in  the  form  k/ue,  e  a  fixed  finite  number  £3  to  allow 

at  least  one  excess  of  pole  over  zeros  for  the  elements  of  F,G,P  in  Fig.  1. 
These  constraints  guarantee  (Horowitz  1975)  that  h(u)  can  be  taken  as  the  magni- 

/v 

tude  of  a  function  h(s)  .  which  has  no  zeros  or  poles  in  the  interior  of 

S-JU) 

A 

the  right  half-plane  or  on  the  jw  axis.  Arg  h(ju>)  is  obtained  from  h(a>) 
by  anyone  of  a  number  of  Bode  integrals  (Bode  1945). 

An  element  of  H(n  )  consists  of  n  positive  functions  on  [o,~],  hjk(u>). 

Using  any  appropriate  Bode  integral,  find  the  associated  phase  function  denoted 

A 

here  by  arg [h^ k(oi) ] ,  giving  the  minimum-phase  stable  function  h . k(s ) , 

A 

h1-(c(jw)  =  ^(w)  +  J  arg[hjk(«*>)].  For  future  use,  denote  this  sequence  of 
operations  whereby  h(w)  is  transformed  into  h(jw),  as  the  "Bode  transformation" 
B(h(u>)).  Define  4>  on  H(n^)  by 

*  =  (♦ll»*12'  ••'•♦nn^:  H(n2)  H(n2)’  *uv*hirh12*  •  »  h„n* 


g  f  -  y  P  .B(h.  (w)) 
auu  uv  .4  ui  v  ivv 1 ' 


I  I 

using  for  P^,  any  specific  fixed  meM.  (Mote  the  similarity  of  (7)  to  (4a, b) )- 

In  Appendix  2,  it  is  shown  that  guu,  fuy  can  be  found  such  that  $  maps 

H(n  )  into  itself.  It  is  also  necessary  to  prove  is  continuous,  as  follows. 

0  is  o  continuous  mapping 


4>  is  continuous  if  each  of  its  n  components  is  continuous.  The  first  step 

A 

in  each  mapping  is  B(hiy(w))  =  hjy(ju>).  In  (Horowitz  1975,  Sec.  Ill)  It  is  proven 
that  the  step  hjy(w)->  arg  hiv(w)-0^v(u))  is  continuous  In  the  C[0,«)  norm.  Hence, 


7 


the  mappings  h.v(u>)->  h.v(u>)  cose.^uO^.^uj) ,  hiv(w)-  h.v(uj)  sin  0.v(u,) 
“X.v(w)  are  continuous.  The  denominator  of  (7)  is  a  constant  on  H(n2),  and 
so  are  guu  fyv  and  the  Py.  in  the  numerator.  Thus,  the  numerator  has  the  form 


Num.  =  |Kfl  +  jKb  -  ?(C.  +  jD.)(£.(u>)  +  jX.(u)),  j  =  ,^T, 

all  other  terms  real  and  only  the^\^,  mappings  on  H(n^).  Infintesimal  changes 

in&. ,  X.  clearly  result  in  similar  change  in  Num.,  so  Num.  is  continuous  on 
2 

H(n  )  and  so  is  each  of  (7)  and  hence  $.  The  conditions  in  Schauder's  theorem 
are  satisfied,  so  $  has  a  fixed  point. 

This  means  3  a  set  of  h.  •(<*>)  denoted  by  h*.(w),  3 

•  J  •  J 


^  .  . 

huv(w)  = 


l9uufuv  PuiNv^u^j 


P  (1  + 
uu(  Puu 


u.v  =  1,  ...,  n,  where  h*v(jm)  =  B(h*v(o>)). 


We  would  now  like  to  deduce  from  (8),  that 


*  *  %u*uv  “A  Pui*\iv^“^ 

B<\>»  >  huv(j„) - 'JB-— - 


(9.  2 


For,  if  (9)  is  true,  then  by  letting  h*v(jw)  -  tuv(j“)»  we  have  recovered  (4) 
and  the  n  huv(jw)  are  a  solution  to  the  mio  problem  for  that  specific  meM. 
The  solution  is  unique  if  every  building  block  in  the  mio  system  has  a  unique 
output  for  any  given  input,  which  is  a  very  reasonable  condition.  This  makes 
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it  unnecessary  to  prove  that  there  are  no  transitions  from  (8)  to  an 

expression  similar  to  (9)  but  with  right  half  plane  poles  and/or  zeros.  Since 

m  is  any  element  of  M,  this  is  true  for  all  mdU  (of  course  with  a  different 
** 

set  of  huy  for  each  m). 

The  step  from  (8)  to  (9)  is  a  crucial  one  and  must  be  justified  with  great 
care.  Given  an  analytic  function  $(s),  there  is  an  infinitude  of  <»(s)  such 
that  U(j<o){  -  (*(ju)|,  id  c[0,®],  e.g. 


*(s)  =  *(s) 


(1  -  T-|  S )  (1  +  t2s) 

II  +  ^s)  (1  -  T^s) 


But  *(s)  /  i|»(s)  even  though  | ( ju>)  |  =  |^(jw)|.  But  suppose  we  know  from  other 
sources  that  <fr^(s)  has  no  right  half  plane  zeros  or  poles,  then  given 


|*1  (jb>)  |  =  M(id)  a  magnitude  function  which  is  Bode  transformable,  we  can 

A 

conclude  that  *i(ju)  =  B(M(w))  =  M(jio).  Hence,  to  justify  (9)  we  must  prove 
that  the  expression  inside  the  vertical  bars  in  (8)  has  no  right  half-plane 
zeros  or  poles.  The  pole  part  is  easy,  because  1  +  9uu/puu  is  obviously 
designed  to  have  no  right  half-plane  zeros;  certainly  guu,  f  won't  be 


assigned  any  such  poles;  h^y(s)  doesn't  have  any  by  definition,  and  P  .  is  not 
allowed  any  such  poles--see  Sec.  3.1.  To  prove  the  zero  part,  note  that  from 
(6)  and  Rouche's  theorem,  the  number  of  zeros  of  the  right  side  of  (9)  in  the 
right  half-plane,  equals  such  number  of 


g  f 
Muu  uv 


0  + 


’uu 

> 

uu 


) 


_ _ 
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which  is  easily  made  zero  in  the  single-loop  synthesis  steps  (if  Puu  has  no 
right  half-plane  poles,  a  condition  necessary  for  other  reasons— see  Sec.  3.1). 
Thus,  the  expression  inside  the  bars  in  (8)  has  no  right  half-plane  poles  or 
zeros,  justifying  (9).  This  is  a  very  valuable  result.  The  problem  of 
stabilizing  a  highly  uncertain  n  x  n  mio  system  is  automatically  disposed  of  in 
the  synthesis  procedure,  which  is  furthermore  one  of  designing  n  single-loop 
transmission  functions. 

Tt  is  worth  noting  that  even: if  the  above  proof  was  not  available,  it 

would  not  be  disastrous  for  this  synthesis  theory.  It  v/ould  only  be  necessary 

to  guarantee  that  at  one  meM,  the  system  is  stable  and  minimum-phase.  For 

then,  this  would  be  soV  meM,  because  by  the  continuity  of  the  poles  (and  zeros) 

with  respect  to  the  parameters,  the  right  side  of  (8)  would  have  to  be  infinite 

(zero)  at  some  w,  in  order  that  for  some  meM  the  system  should  be  unstable 

(or  have  a  right  half-plane  zero).  However,  the  synthesis  procedure  by 

definition  precludes  this.  And  it  is  a  relatively  easy  matter  to  guarantee 
•  • 

the  desired  conditions  at  one  meM.  . - 

3.  CONSTRAINTS  ON  MIO  PLANT 

The  above  results  hinge  on  our  ability  (a)  to  find  gyu  and  fyy  to  satisfy 
(6)Vw,  all  u,v  pairs  and  all  meft  (b)  that  each  equivalent  single-loop  design 
is  stable  and  minimum-phase  V  me)t.  These  lead  to  constraints  on  the  mio  plant, 
obtained  by  applying  single-loop  design  theory  to  achieve  (a,b).  Appendix  i 
gives  an  existence  theorem  for  single-loop  design.  The  first  part  of  the  design 
(see  Appendix  A3)  gives  bounds  on  the  nominal  loop  transmission  which  is 
guu/pUUo  of  where  pUuo  the  'nonrina1'  associated  with  a  nominal  m0e)i. 


These  bounds  must  be  satisfied  in  order  that  a  specific  system  transfer 
function  tuv  satisfy  (1).  Here  9UU/PUU0  is  used  for  n  tuy  (v  =  l,...,n) 
functions.  It  is  proven  in  A3,  that  a  9UU/PUU0  can  be  found  which  satisfies 
the  conditions  for  all  n  t  functions. 

For  example,  consider  t^  at  u>  =  Uj  and  suppose  6U1 (“1 )  - 

1.1  in  (1).  We  could  split  this  range  {.9,  1.1]  into  say  [.95,  1.05]  for  tu-j 
and  .05  for  T^uldul  in  (4),  using  dy1e  of  (5)  for  d^.  The  technique  in  A3 
or  better  (Horowitz  and  Si di  1972),  is  then  used  to  find  a  bound  on  9uu(jm^). 
Here,  we  note  a  tough  constraint.  Sooner  or  later  in  to,  jguu(jto)|  must  become 
very  small  with  1  +  9UU/PUU  1  and  then  in  (4a) 


g  f 
3uu  uv 


(10) 


and  in  (7),  \i> uv  the  numerator  of  its  right  side  divided  by  £yu.  Now  (4a,  5,  6) 

in  general  require  that 

^uv^max  >  ^Tduvduve^ 

But  lluvlmax  =  Buv  and  at  high  frecluencies 


To  see  what  this  leads  to  take,  for  example,  n  =  2  so  that  the  above  applied 
to  v  =  1 ,  u  =  1 ,2  gives 


requiring 


3  S  a)  -*■  <*> 


Thus,  a  constraint  on  ?  is 


^2a)‘  3  “h*  ^  ^or  10  >  uh’  1^11^22^  *  4  ^P12P21  I^roE^* 

It  is  known  that  as  s  -»■  », 


so  the  above  becomes 

lkllk22 1  >  4 I kl 2k21 1 

ell+e22  >  e12+e21 

U  b) 
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(12) 


(13) 


If  the  uncertainties  in  the  k^  are  independent  and  e^  +  e?2  =  e]2  +  e21, 
this  becomes 

kllmink22mi».  >  4k12maxk21max*  (U) 

There  is  an  important  problem  class  for  whi  he  inequality  is  less 
harsh.  This  is  the  "basically  noninteracting"  class,  where  one  ideally  desires 
4ij  5  0  for  1  *  3»  but  because  of  uncertainty  accepts  *  0,  |t^|  < 
for  i  t  j,  in  (1).  Also,  one  doesn't  care  if  t^(i  t  j)  is  nonminimum-phase. 
Condition  (6)  then  applies  only  to  u  =  v.  The  f  (u  f  v)  are  set  equal  to 
zero  and  (13)  becomes 

3  V3’  *P11P22 1  >  2lP12P2ll  meM,  u  >  05) 


It  is  desirable  to  ease  inequality  (13)  in  the  general  case.  Note  that  (6) 
can  be  satisfied  over  any  finite  u  range  by  making  |1  +  9UU/I?UU!  large  enough. 

Thus,  as  previously  indicated,  one  can  split  the  [Auv,Buv]  tolerance  so  that 
lTuvl  >  lTduvllduvel’^meM*  e-9*  assi9"  lTuvl  e  [E  -  £,  E  +  e]  with 

E  =  ^Auv  +  Buv>/2>  2e  <  Buv  "  Auv  and  the  balance  (Buv  “  Auv  -  2e)/2  is  assigned  to 

Tduvduv  But  M  +  5uu/?uu|  must  then  be  made  large  enough  to  satisfy 

the  resulting  requirements,  and  it  can  for  any  finite  u  range.  The  trouble  is 

that  9uu  must  be  a11owed  t0  zero  as  u  +  «,  leading  to  (13),  etc.,  if  we 

insist  on  (6).  We  could  ignore  (6)  at  large  to,  say  for  to  >  u>u,  with  as 

H  H 

large  as  desired  but  finite,  letting  |xuv|  «  Uduvl lduvel  for  u  >  ^  Then 
for  u  >  (11)  is  replaced  by  the  weaker 

|tuv,m«X  *  •Wmrel  (,6> 

and  for  n  =  2,  (13)  is  then  replaced  by 

(P2b>:  3  %>  B  ^r  u  >  v  |PlfP22|  >  iP12P21|,VmE«  (17a) 

.-.An  important  question  is  whether  (17a)  is  an  inherent  basic  constraint  in  the 
presence  of  uncertainty,  no  matter  what  design  technique  is  used,  or  is  due 
only  to  this  specific  design  technique.  The  methods  suggested  in  (Rosenbrock 
1974,  Owens  1978)  to  achieve  diagonal  dominance,  may  be  helpful  in  satisfying 
(17a),  but  they  would  have  to  be  extended  to  uncertain  plants.  Note  that  in 
Rosenbrock  1974,  Owens  1978),  diagonal  dominance  is  desired  V  w  e  (0,°°), 
whereas  in  (P^)  it  is  required  only  for  w  > 

For  the  analog  of  (17a)  at  n  =  3,  it  is  found  that  diagonal  row  dominance 
of  P"^  for  u>  >  uu,  is  a  sufficient  condition.  The  necessary  condition  can  be 


written  as 
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/I 

3v  ?,orM>nt  ipiipjji >  ipijpjii  a"d 

lp11p33l  >  ^P12P23^  +  lP13P22^^lP22P31 1  +  lP21P32^  (13b) 

which  can  be  written  as, 

lPllP22P33l  >  lPllP23P32^  +  ^P12P21P33^  +  lP12P23P3ll 

+  Ip-|3P22P31  I  +  lP13P21P32  |  for  u>  >  wH  .  (17c) 

The  latter  has  the  following  intepretation.  Array  the  matrix  P~*  in  the  usual 
manner,  but  twice -one  under  the  other  as  in  Fig.  3a.  Then  the  terms  on  the 
right  side  of  (17c)  consist  of  the  products  of  the  entries  crossed  by  the 
dashed  lines. 

However,  if  is  so  used,  it  is  no  longer  possible  to  use  Rouche's 
theorem  and  thereby  prove  each  t.^  is  minimum-phase.  But  we  can  still  design 
so  that  the  nominal  t^  are  minimum-phase  and  we  know  from  (6)  that  t^(jw)  f  0 
for  ue[0,u^].  Therefore,  from  the  continuity  of  the  zeros  of  t^  with  respect 
.to  the  parameters  of  the  system,  if  t. .  has  any  right  half-plane  zeros,  they 
must  enter  the  right  half-plane  as  shown  in  Fig.  3b.  It  is  unlikely  that  such 
a  zero  which  must  migrate  all  the  way  up  to  ju>H,  should  move  back  into  the 
*  significant  control  biindwith  region  A.  The  point  is  that  if  right  half-plane 
zeros  are  "far-off",  they  have  little  effect  and  the  system  Is  "dominantly" 

‘  minimum-phase. 


Rouche’s  theorem  can  still  be  used  if  we  can  guarantee  that  (6)  is 

satisfied  for  a  semicircle  consisting  of  the  segment  and  the  right 

half-plane  half- circumference  of  the  circle  of  radius  uu,  centered  at  the 

H 

origin.  Then,  there  are  definitely  no  right  half-plane  zeros  of  t. .  in  this 

*  3 

half-circle,  and  the  system  ’$  "dominantly"  minimum-phase  This  is  quite 
practical  in  the  design  technique  of  (Horowitz  and  Sidi  1972),  discussed  in  A3. 


3.1  Modification  of  mapping  $ 

Note  that  for  the  "dominantly  minimum-phase"  and  the  "basically  noninter¬ 
acting"  cases,  the  application  of  Schauder's  theorem  in  (2.1),  Eqs.  (7-9),  etc., 
needs  modification,  because  nonminimum- phase  tuv(jw)  cannot  be  uniquely 
derived  from  |tuv(jw)|.  Redefine  h  e  Huv  of  2.1  to  consist  of  an  ordered 
pair:  h(w)  as  before  and  q(u),  the  imaginary  part  of  h  (jw)  with 
h  -  |huv<Ml;  h  e  Huv  the  same  as  before  but  q(oj)  c  C  [0,<»)  with 
0  <  |q(w)|  <  h(u).  Constraints  2,3  in  2.1  on  h(w)  also  apply  to  q(u>).  Let 
(HQ)UVCC2  [0,«>)  denote  the  set  {(h(ui),  q  (u>) )  >  with  j|(h,q)||  =  |jh||  +  1 1 Q 1 1  • 
Obviously,  (HQ)uV  is  compact  and  convex  in  C2  [0,°°).  The  extension  to  the 
n^  product  set  is  straightforward. 

The  mappings  4iuv  in  (7)  are  redefined.  Each  \{>uv  is  a  pair  of  mappings, 

one  the  absolute  value  as  before,  the  second  the  imaginary  part  with  the 

absolute  bars  on  the  right  removed.  On  the  right  side  of  (7),  B(h.v(u>))  is 

o  o  o 

replaced  by  r.v(u>)  +  jqiv(w),  with  h^v  =  r.y  +  q.y,  (h.y,  q^v)  e  (HQ).y. 

It  is  necessary  to  prove  that  $  maps  each  element  of  (HQ)UV  into  itself. 
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The  proof  follows  immediately  from  that  for  the  minimum-phase  case  --  this 
is  obvious  from  (6),  the  definition  of  dyve  in  (5),  and  Appendices  1,2.  The 
proof  that  t  is  continuous  is  straightforward.  Accordingly,  the  Schauder 
conditions  are  satisfied  and  there  exists  a  fixed  point  which  satisfies  the 
specifications.  Such  specifications,  by  themselves,  would  not  be  good  ones 
because  they  permit  highly  nonminimum-phase  tuv(s ) .  However,  they  are 
satisfactory  if  it  is  known  from  other  sources  that  tuy  is  "dominantly 
mini mum- phase". 

3.2  Additional  Constraints  on  P 

Constraints  Al(l)-(3)  in  the  Appendix,  must  be  applied  to  the  l|Pu(J, 

since  in  Fig.  (2)  p  =  =  p  of  Appendix.  Al.l  requires  that  there  be 

UVe  uu  1 

no  change  in  the  excess  of  poles  over  zeros  of  where  A  =  det.  P 

uu  auu 

and  Auu  its  uuth  minor,  as  m  ranges  over  Also,  that  for  at  least  one 
meji,  denoted  by  mu£),  Puu  has  all  its  poles  and  zeros  in  the  interior  of  the 
left  half-plane.  The  mUQ  can  be  different  for  each  u. 

A1.2  requires  that  1/PUU  is  minimum-phase V  mej(,  and  its  zeros  do  not 
get  arbitrarily  close  to  the  jw  axis.  Since  1/PUU  =  A/Auu,  this  weans  A  must 
have  no  right  half-plane  zeros.  Hence  the  in  general  have  no  right 
half-plane  poles.  (For  those  who  wish  it,  P  is  restricted  to  be  controllable 
and  observable  V  me^,  but  these  concepts  are  unnecessary  if  P  is  properly 
formulated  in  terms  of  physical  uncertain  parameters  (Horowitz  and  Shaked 
1975)).  Since  the  p..  in  P  =  [p.-l  are  finite  rational  functions,  the  latter 
part  of  A1.2  is  automatically  satisfied. 


A1.3  for  n  =  2  is  the  same  as  (17),  which  shows  that  (17)  is  a 
fundamental  condition  for  linear  time-invariant  design,  not  an  "extra" 
condition  due  to  our  design  technique,  at  least  for  n  -  2.  However,  (13) 
is  an  extra  condition.  Note,  the  extension  of  single-loop  design  to 
disappearing  poles  and  zeros  in  A6  may  perhaps  permit  disappearing  poles 
and  zeros  in  the  mio  plant  functions. 


The  previous  design  equations  constitute  only  one  of  many 
design  techniques  derivable  from  Schauder's  fixed  point  theorem.  Only 
two  more  will  be  briefly  mentioned  here. 

Both  are  based  on  the  use  of  a  nominal  diagonal  loop  trans¬ 
mission  matrix.  The  design  obligations  on  the  loop  transmission 

elements  are  then  independent  of  the  way  the  plant  input  and  output 
terminals  are  numbered.  If  G  is  made  diagonal,  such  numbering  is 
important  and  after  one  arbitrarily  numbers  the  plant  input  terminals, 
he  should  try  to  number  the  outputs  such  that  the  main  effect  of  in¬ 


put  i  is  on  output  i.  Manipulation  of  (2)  somewhat  differently  from 


'  Sec.  2,  gives 


-  f11&ll/6ll  *  i^l  11  11 

11  "  1  +  «-11/611 

t  =  f21&22/622  W2  21  11  22 

1  +  *22/622 


ppi  ■ 
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where  V  =  Iv..^]  =  \  is  the  'nominal' plant  matrix  and  there¬ 

fore  fixed,  P  is  the  general  uncertain  plant  matrix,  =  1  -  v... 

The  Z...  are  the  nominal  elements  of  the  loop  transmission  matrix  L. 
Eqs.  (18)  lend  themselves  to  single-loop  design  and  use  of  5chaiider's 
theorem,  pricely  as  did  (4). 

Another  interesting  set  of  design  equations  is  obtained  by  de¬ 
signing  to  control  the  changes  in  t..,  rather  than  t. .  directly.  Let 

'  J  13 

T  =  It-iJ  be  the  'nominal'  system  transfer  matrix  and  T  =  (t. .]  the 
0  1JO  ij 

actual  which  is  uncertain,  AT  =[At. .]  =  T  -  T  .  Then  It  can  be  shown 

ij  0 

that 


AT  =  (I+Lf1  VT,  V  =  I-20P_1 


(19) 


where  PQ,P  are  likewise  the  'nominal'  and  uncertain  plant  transfer 

matrices,  and  L  =  P_G  =  [t.J  is  the  nominal  loop  transmission  matrix. 

0  ij - r 

If  L  is  taken  diagonal,  the  result  is  (n  =  2  for  simplicity) 


Vntn  *  V12*2l 

Atll  "  1  +  ’  At12 


V  t  +  V  t 
11  12  12*22 


1  +  t 


n 


(20) 


and  similar  obvious  ones  for  At2j,  At22. 

The  design  problem  is  now  completely  one  of  disturbance 
attenuation,  with  the  disturbances  d^  =  v^t^  +  v^t^,  etc.,  whose 
range  is  known.  Schauder's  theorem  is  applicable  in  the  same  manner 
as  before.  Note  that  V  represents  the  'normalized'  plant  variation 
matrix.  Eqs.  (20)  appear  to  be  much  simpler  to  use  for  design  (once 


the  At.  .  tolerances  are  formulated)  than  (4),  and  their  use  needs  to 

*  J 

be  intensively  researched.  However,  both  for  (18)  and  (20)  the  con¬ 
straints  considered  in  3.,  leading  to  (11-15)  must  be  found,  and 
these  may  possibly  be  tougher  than  before.  Also,  both  a  nominal  £ 
and  T  must  be  chosen^which  is  not  goodj because  the  optimum  pairing 
is  not  apriori  known.  However,  the  analogs  of  (14,17)  may  be  more  lenient. 

4.1  Bandwidth  Minimization 

An  important  criterion  for  comparison  of  design  techniques  is 
their  "cost  of  feedback,"  which  we  take  as  the  bandwidths  of  the 
loop  transmission  functions— because  they  determine  the  system 
sensitivity  to  sensor  noise.  Obviously,  quantitative  synthesis 

techniques  must  first  be  invented  before  one  can  turn  to  their  op¬ 
timization  (for  without  such  quantitative  techniques  comparison  is 
possible  at  best,  by  analysis  after  a  specific  numerical  design  has 
been  made).  This  approach  via  Schauder's  theorem  promises  to  generate 
a  variety  of  such  techniques,  and  the  next  step  will  be  optimization. 

5.  DESIGN  EXAMPLE 

The  2  x  2  plant  elements  are  p..  =  k../(l+sA  )  with  correlated 

•  J  *  J 

uncertainties,  giving  a  total  of  9  parameter  sets  in  Table  1.  The 
design  was  performed  to  handle  the  convex  combination  generated  by 
these  9  sets  (Figure  6). 


TABLE  1 


No. 

kll 

k22 

k12 

k21 

A22 

A12 

^21 

1. 

1 

2 

.5 

1 

1. 

2 

2 

3 

2. 

1 

2 

.5 

1 

.5 

1 

1 

2 

3. 

1 

2 

.5 

1 

.2 

.4 

.5 

1 

4. 

4 

5 

1 

2 

1. 

2 

2 

3 

5. 

4 

5 

1 

2 

.5 

1 

1 

2 

6. 

4 

5 

1 

2 

.2 

.4 

.5 

1 

7. 

10 

8 

2 

4 

1. 

2 

2 

2 

8. 

10 

8 

2 

4 

.5 

1 

1 

2 

9. 

10 

8 

2 

4 

.2 

.4 

.5 

1 

A  “basically  noninteracting"  system  is  desired,  with  the  off-diagonal 
transmissions  specified  in  the  w-domain  |t12(ju))|,  1 121  ( | <0. 1  Vu.  The 
diagonal  t^,  t22  bounds  are  identical  and  were  originally  in  the  time- 
domain  in  the  form  of  tolerances  on  the  unit  step  response  shown  in 
Fig.  4a,  b  (which  also  shows  the  design  results  for  those  of  the  9  cases 
which  were  reasonably  distinguishable).  These  time-domain  bounds 
were  translated  into  the  "equivalent”  bounds  on  |t^.(juj)j  shown  in 

Fig.  5  (Horowitz  and  Sidi  1972,  Krishnan  and  Cruickshank  1977). 

»  • 

Familiarity  with  quantitative  single-loop  design  is  assumed 

here  .  One  can  do  a  problem  of  this  complexity  by  hand.  The 

sets  (Piie(ju>)},  called  the  plant  templates,  are  obtained  on  the 

Nichols  chart.  Some  of  these  templates  of  ]?  =  r~ 

u  p22  ZZ  Pn 


are  shown  in  Fig.  6  at  various  u>  values.  The  larger  the  template* 

the  greater  uncertainty  at  that  ui  value.  The  tolerances  on  t  of 

uu 

(4a)  and  Fig.  5  were  divided  between  and  TduiJduu  as  discussed  in 

Sec.  2.  Each  of  these,  in  conjunction  with  the  templates,  leads  to 

g 

bounds  on  the  nominal  loop  transmission  l  =  Some  of  these 

UU)0  i. 

uuo 

boulds  on  2...^,  due  to  are  shown  as  solid  lines  in  Fig.  7,  i.e., 

it  is  necessary  for  £11q  to  lie  above  the  indicated  boundary.  The 

tolerances  on  x.  d  lead  to  the  dashed  line  bounds  on  .  No 
auu  uu  iio 

attempt  was  made  to  optimize  the  division  of  the  tolerances  between 
x^  and  T(mdj.j.  The  composite  bound  on  must  satisfy  both. 

The  £,jlo(jw)  chosen  is  also  shown  in  Fig.  7.  There  was  no  attempt 
made  to  optimize  the  £„o*,  the  design  was  made  by  hand  quickly,  so 
the  £..-o(ju))  are  larger  than  need  be,  v/ith  the  tolerances  therefore 
satisfied  better  than  necessary— as  seen  in  Figs.  4a,  b.  Optimal 
tjioUu)  would  lie  on  their  boundariesat  each  w ,  so  in  this 
example  there  is  considerable  overdesign. 

Here  we  took 

.  -A_a  _  10  (H.007S) _ ^ _ 

llo  p  yll  “  S  (l+.025s)M+s  s** 

l  400  (400)  j 
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wi  th 


Ao  .75  (1+3. 66s) 
f22o  “  (l+s)(l+3s)  ; 


*22o 


(l+.02s) _ 

(l+.ls)  fl+s  ,  s2  ! 
L  150  (150)2J 


with 

AQ  1.5  (1+3. 66s)  . 

f,lo  "  (1+3s){1+2s) 

The  requirements  on  f^,  f22  (f]2  =  f^  =  gJ2  =  g21  =  0  here)  were 
found  using  single-loop  design  technique  [15]  as  briefly  explained 
here  in  A4,  and 


fll  =  1  +  .5s  *  f22  =  1  +  .33s' 

were  found  satisfactory.  The  system  was  simulated  on  the  digital  com¬ 
puter  with  the  resulf i  shown  in  Figs.  4a,  b.  The  t12>  t2J  tolerances 
were  easily  satisfied  by  the  design. 

While  this  is  not  a  very  challenging  example  of  the  design  techni¬ 
que,  nevertheless  the  uncertainty  is  very  large  and  one  should  consider 
how  quick,  simple  and  straightforward  was  the  design  procedure,  and 
also  consider  what  alternatives  are  offered  in  the  mio  literature. 

There  are  no  other  techniques  available  for  systematic  design  to 
specifications  in  the  presence  of  significant  uncertainty,  which 
guarantee  design  convergence  and  attainment  of  design  tolerances. 
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Whatever  present  popular  technique  is  used,  it  would  be  necessary 
to  cut  and  try  and  endeavor  to  understand  the  relations  between  the 
cutting  and  the  results  as  one  continued  to  cut  and  try,  because 
these  techniques  have  no  provision  for  significant  uncertainty.  In 
the  above  design,  one  sweep  was  known  to  be  sufficient  because  the 
plant  and  the  design  tolerances  (u-domain)  satisfied  constraints, 

PI  etc. 

5.  EXTENSION  TO  NONLINEAR  UNCERTAIN  HIP  PLANTS 

Once  there  is  a  quantitative  design  technique  for  linear  time 
invariant  mio  uncertain  plants,  it  appears  at  least  conceptually 
possible  to  extend  it  to  a  significant  class  of  nonlinear,  even 
nonlinear  time-varying,  uncertain  mio  plants.  The  procedure  is  a 
generalization  of  that  used  (based  also  on  Schauder's  theorem) 
in  (Horowitz  1976)  for  single  loop  uncertain  nonlinear  systems. 

The  key  feature  is  the  replacement  of  the  nonlinear  plant  matrix 
set  (a  set  because  of  the  uncertainty),  by  a  linear  time  invariant 
plant  set  which  is  precisely  equivalent  to  the  original  nonlinear 
set,  with  respect  to  the  acceptable  system  output  set.  The  pro¬ 
cedure  is  briefly  presented  for  the  case  where  one  wants  the  system 

with  nonlinear  uncertain  plant  to  behave  like  a  linear  time-invariant 
system  for  a  specified  class  of  command  input  sets. 
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It  is  essential  that  the  command  input  sets  represent  a  good 

sampling  of  how  the  system  will  actually  be  used.  For  example,  suppose 

n  =  3  and  in  actual  use  y  r^  always  exist  simultaneously  (with 

r3  =  0),  and  r3  appears  by  itself  (with  r1  =  r2  =  0).  Say  there  are 

ten  typical  r^(t)  inputs  and  for  each  typical  r^t)  there  are  five 

typical  r2(t).  This  makes  a  subtotal  of  50  input  sets,  to  which  is 

added  the  number  of  typical  r3( t)  say  10,  giving  a  class  R  =  {?}  of 

60  sets,  of  which  50  have  the  form  r  =  (y  r^,  0)  and  r  *  (0,  0,  r3) 

for  the  balance.  Choose  r^eR.  The  family  of  acceptable  outputs  for 

this  input,  is  known  from  the  tolerances  on  t..,  giving  for  that  one 

1 J  " ' 

input  vector  a  family#  *  {h},  h  =  (fy  ly  h3).  The  mio  plant  is  re¬ 
presented  by  a  family  (because  of  parameter  uncertainty)  W  of  nonlinear 
differential  mappings 

&/=  (W),  W  *  (w1,w2,w3>*  C1  =  w1(x2,x2,x3,m),  .  .  .  ,  c3  = 

»"here  the  x»  are  the  plant  inputs, c.  the  plant  outputs, 
and  m  is  the  plant  parameter  vector  meM. 

Take  a  sample  acceptable  outputtriple  h  =  (ly  ly  h3)  and  find 
the  corresponding  plant  inputs  at  some  specific  m&M  (or  in  other  words, 
pick  a  MeW)  and  let  c^  =  h^  and  solve  the  nonlinear  equations  backwards, 
giving  the  input  set  (x^,  x 3).  Take  the  Laplace  transforms  £.(s) 
of  fij(s)  of  giving  the  vectors  x[s]  =  (x^s),  x2(s),  x3(s)) 

fitsl  =  (fi^s),  ....  fi3(s)).  Repeat  for  other  h  samples  in  the 
acceptable  output  set  H,  giving  two  paired  families  of  X[s),  n^[s). 


A 

Select  any  combination  of  three  x [si ,  forming  a  3  x  3  matrix  X  and 
corresponding  paired  combination  of  three  forming  the  matrix  D. 

Set  H  =  PX  and  solve  for  P  =  H(X)  \  P  is  the  1  inear- time-invariant 
equivalent  of  the  specific  WeW  picked,  with  respect  to  the  specific 
trio  of  acceptable  output  vectors  picked.  Repeat  over  different 
trios.  Repeat  the  entire  operation  over  different  wet',  giving  a 
class  =  (P>  which  is  the  linear-time-invariant  equivalent  of  the 
W  family,  with  respect  to  the  class  of  acceptable  outputs  H  for  in¬ 
put  vector  ?,.  Repeat  the  entire  operation  for  r  ,  .  .  .  ,  ?  giving 
{^i}  =  P  total  which  is  the  linear  time  equivalent  for  the  nonlinear 
w,  with  respect  to  the  tribe  of  60  families  of  acceptable  output  sets. 
The  equivalence  is  exact  if  the  conditions  for  application  of 
Schauder’s  theorem  are  satisfied.  We  now  have  a  linear  time-invariant 
uncertain  mio  problem,  which  let  us  presume  we  can  solve.  If  and  only 
if  we  can  guarantee  the  solution  of  the  latter,  then  the  same  compen¬ 
sation  functions  will  work  for  the  original  nonlinear  uncertain  mio 
plant.  Hence  the  importance  of  quantitative  linear  time  invariant 
design  techniques  (over  and  above  their  intrinsic  importance) —for  they 
enable  the  precise  solution  of  nonlinear  uncertainty  problems. 

The  design  effort  in  the  above  appears  to  be  enormous  but  it  is 
conceptually  straightforward  and  easy.  An  ordinary  control  engineer 
can  implement  it  and  the  digital  computer  is,  of  course,  an  essential 
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tool.  Conceptually  too,  it  appears  possible  to  extend  the  method  to 
obtain  nonlinear  relations  between  inputs  and  outputs  within  specified 
bounds,  despite  large  plant  uncertainty,  even  nonlinear  time-varying, 
as  can  be  done  for  the  single  input-output  case.  -  .  The  prospect 

is  fascinating.  Imagine  being  able  to  work  with  the  actual  nonlinear 
equations  of  a  jet  engine,  or  a  chemical  process,  etc.,  include  un¬ 
certainties  in  the  modelling,  even  uncertainty  in  system  order  (see 
Appendix),  and  designing  to  achieve  outputs  within  specified  tolerances 
over  the  given  range  of  uncertainty. 


6.  DISTURBANCE  ATTENUATION 

Let  x  in  Fig.  1  be  a  n x 1  matrix  of  distrubances.  The  resulting 
system  output  (with  r  =  0)  is  c  =  (I  +  PG)"1  Px  ^  Zx,  Z  *  {zig],  the  nxn 
disturbance  response  matrix.  Bounds  on  Z  are  given  in  the  form 

|zuv(joj)|  <  buv(w)  ,Y  m zl\  (21) 

Rewrite  c  =  Zx  in  the  form  (P-1  +  G)c  =  x.  Let  x.  f  0  only  for  i  *  v,  so 

ci  ■  and 

l  <PU1 +  Sul  );£1V  =  6v  =  (?:  u  S  v>  • 

1=1 


Let 


*uve<“> " sup  l  l-Jr^Mi!biv(w)  (23) 

m  uj 

The  9ul-(w)  ( i^u)  can  be  chosen  to  minimize  xuve(“)»  but  for  simplicity  we  shall 
assume  them  zero.  From  (22,23) 


If  1/P  satisfies  the  constraints  listed,  then  it  is  obviously  possible 
to  guarantee  |zuv(u)j  <  any  finite  number,  no  matter  how  small,  at  any  finite 
u.  Also  it  can  be  made  zero  at  a  finite  number  of  w  values  by  assigning  poles 
to  guu  at  these  values.  Assume  that  gyu  can  be  chosen  to  satisfy  (21) 

V  we  [0,»).  Then  one  can  set  up  the  conditions  for  Schauder's  theorem, 
precisely  as  was  done  in  2.1.  The  set  buv(w)  must  have  been  formulated  such 
that  B(n£),  the  n  product  set  of  the  buV(u>),  is  compact  convex  in  C(n 

A 

analogous  to  H(n  )  in  2.1.  The  analog  of  4>  in  (7)  must  be  formulated 

with  the  modification  of  Sec.  3.1,  inasmuch  as  we  do  not  care  if  the  zuy(s)  are 

nonminimum-phase. 

Conditions  analogous  to  (12-17)  for  n  =  2,  are  obtained  as  follows. 

As  w  ->  “,  9uu/puu  +  0  so  in  (24),  the  right  side  -*•  its  numerator.  But 
|zuv( jto) |  <  buv(w)  of  (21).  Let  u  =  1,  v  =  2  and  then  u  =  2,  v  =  1  and 
obtain  the  necessary  condition  (for  g^  =  92j  =  0)» 


As  w  , 


p12p21  <  pllp22  ’  ^ 


(25) 
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similar  to  (17)  but  here  only  at  «>,  because  there  is  no  concern  with  the 
minimum-phase  property.  Setting  u  =  v  =  1 ,  and  then  u  =  v  =  2  in  (24),  we 
get  the  conditions 


bll  >  Ip^l  =  lpl 


P12p21 

p22 


p12p21 


But  in  reality  as  <u  -*■  «»,  c  -*  Px  so  Z  ->  P  and  z^  -*■  p^,  z22  p22 .  Hence, 

assignment  of  b^  (as  o>  -*•  »)  to  satisfy  (25)  is  no  obstacle,  because  the  buy(oj) 
are  upper  bounds  on  the  lzuv(jw)l- 


APPENDIX  1 

EXISTENCE  THEOREM  FOR  SINGLE-LOOP  DESIGN 

The  plant  transfer  function  p(s)  is  uncertain,  belonging  to  a 
set  P=  {p (s ) }  and  is  imbedded  in  a  two-degree-of-freedom  single¬ 
loop  feedback  structure,  as  in  Fig.  2  (p  in  place  of  p  ).  The 

uve 

rational  functions  f(s),  g(s)  (replacing  f  ,  gyu  in  Fig.  2)  are 
to  be  chosen  to  satisfy  specified  tolerances  on  the  command  fre¬ 
quency-response  t(jio)  =  j  and  disturbance  frequency  response 
td(jw)  =  c(joj)/d(ju),  (r,  d,  c  replacing  ry,  -d^,  cy  in  Fig.  2). 

A1 .  Constraints  on  P 

1.  p(s)  is  a  rational  function  with  a  fixed  excess  e>l  of 

poles  over  zeros  (this  is  relaxed  later  in  A6,  7).  3  at  least  one 

peP  one  of  which  is  designated  as  pQ,  all  of  whose  poles  and  zeros 
are  in  the  interior  of  the  left  half-plane. 

2.  At  each  u>e[0,«>),  a  irrf.  |p(jaj)|  =  b(w)>0.  3  inf  b(u) 

=  bj>0  for  any  finite  interval  I  =  [0,u].  Also,  |po|  of  Al(l)  has 
a  sup  on  each  finite  interval  I  =  [0,o>],  sup  |pQ|  =  xqj. 

3.  As  s->~,  p(s)->-kp/s  ,  kpCfk^,  kg]  with  kg>k1>0,  uniformly 

on  p  in  the  following  sense:  For  any  e>0,  no  matter  how  small,  3 

(independent  of  p(s)),  such  that  for  each  peP  there  is  associated  a 

k  elk,,  k_]  so  that 

p  1  2 

|anl  f"H|  <e  and  Arg  |  p(ju)+ej|<e,  for  * 
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Note  that  Al(l)  permits  changes  in  plant  order,  e  q  ,  -*aTis 

1+  T^s 

with  say  a  e  [2,  5],  T^  c  [0,  3].  Al(2)  dictates  minimum-phase  p(s) 
and  that  the  jio  axis  is  not  a  limit  of  any  sequence  of  p(s)  zeros. 

Al(3)  requires  a  uniform  bound  on  the  poles  and  zeros  of  all  peP. 

A2.  Tolerances  on  lt(.i(u)|  and  |tn(.iu)l 

(1)  0<A(oj)  $|t(jw)|$B(u>)  with  A,  B  e  C  [0,  °°),  >0(u)>l. 

Alo)J 

3  inf  3(w)  =  3  >1  on  any  finite  I  =  [0,u]. 

1  Xk 

(2)  9  X  >  1.05,  $  for  us>u This  means  that 

in  the  high  co  range,  the  feedback  is  allowed  to  increase  the  sensitivity 
^  _  3t(ju))/t(jw) 

S  3p(ju)/p(jto)*  rather  than  decrease  it.  In  fact,  as  noted  by 
Bode , 

0 

in  S( | S | <1 )  achieved  in  the  control  bandwidth  range,  must  be  balanced 
by  |S|>1  in  another  range.  X  can  be  a  large  number,  because  as 
t(ju)-K),  e.g.,  suppose  kg/k^  =  10,  who  cares  if  | t(ju>)  |  ctlO"11,  10“7] 

(X  =  10  )  at  very  large  w. 

(3)  The  tolerances  on  t^ju)  are  in  the  form  |td(ju>)|$Q(u>)>0. 

For  any  I  *  10,  w],  3  inf  Q(w)  =  BdJ.  Since  td  =  P(1  +  pg)"1  = 

pS  of  A2(2),  |Q/p|>l  at  high  frequencies,  so  3  w,,  3  for  u>oj., 

d  a 

Q(u>)  =  3-,  (a») )  p( jb>| ,  B.j>1.05. 


! 


1  n | S | doa  =  0  in  any  practical  system,  so  the  decrease 


....  1 1  I.  1 

•  ■ 


stricted  to  the  interior  of  the  left  half-plane  VpeP,  and  minimum- 
phase. 


A3.  Choice  of  Compensation  Functions 

Let  pQ(s)  of  A1 (1 )  be  the  'nominal*  plant  with  k  elk^,  its 

associated  k  value  of  Al(3). 

P 

Let  €  -  .01  kQ  in  Al(3),  wt  =  largest  of  {u>£,  u>d),  I  = 

kT 


4=  sup  K(Jm)I  . 


of  A1 (2).  In  Fig.  2, 


!t  br 


t(s)  =  =  — —  ,  l  =  g  p  . 

1+gp  po  o  a  Ho 

p  +\> 


sup  |t(ju))| 

jP _  /  B(to) 

inf  1 1( joj) |  N  A(w) 

P 


We  want  r,,.  \i  4  of  A2(l).  This  is  achieved 


P  . 

sup 

0+0 

p 

P 

inf 

P 

Prt  +  * 

0 

p 

p  |  i  |  +  Yt 

Since  ~  <  yt  in  It»  it  suffices  for  It>  if  | £,q | >Y^and  , 

o  ^t  t 

giving  the  sufficient  condition 


1*1  »Yt  +  V 

°  Ji _ 4  t#J.  1°  I.. 

W,  -  >)  0  * 
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To  satisfy  A2(3)  in  1^,  it  is  necessary  that  |t  |  = 


d'  |l+gp| 


PQ  <Q(w),  which  is  certainly  achieved  if 

-  +  £ 

P  0 


sup|P0l  sup|p0| 


tsupiPoi  X ,  4  „  I 

A«  WT=  °M\  X)  '-*1- 


Therefore,  choose 

|l0(j»)|>  larger  of  (|£ot|,  Uodl  )“U0XI »  in  If 
Next,  we  find  a  bound  on  £  in  I  =  [u>  ,«)  to  satisfy  A2  in  I  . 

Out  V 

From  A1  (3),  in  =  [u^.,  coj  9  {Z^}  lies  in  the  narrow  sliver  V  in 
k 

Fig.  Al,  4  .01  r—  4.01  radians  angular  width,  with  magnitude  bounds 
K2 


.99  ^  ,  1.01  ^ 
K2  \ 


Let  A  in  Fig.  Al  be  a  trial  value  of  A  ,  so 

o 


P  P 

r  0  rn 

—  +  £q  is  the  vector  originating  at  point  —  in  V  and  terminating 

at  A.  Bounds  on  £  may  be  obtained  so  that 
o 


sup  lo 

P  P  o 

inf  Pn 

*  -£  +  £ 
P  o 


satisfies  A2(/,2)and  A2(3)  in  1^=  [u^,  «). 


It  is  easily  seen  that  a  very  conservative  boundary  for  £q  in 
is  the  vertical  line  s  =  -o,  with 

k0  I *99X  -  1.01  \  .  „ 

•■v-f  |vt) 

i.e.,  £  on  the  right  of  the  line  s  =  -o,  satisfies  A2(l,  2)  in  1^. 


(A4a) 


1 _ p  1  - 

Ko 

£  31  |pi ,  or 

vo/  fJ 

11  +  pq  1 

p  0 

P  o 

*  v 


This  is  easily  satis¬ 


fied  if  the  above 


o  =  a2=  .99^(Brl) 


(A4b) 


2  e 


1 


Therefore,  choose 


a  =  smaller  of  (o^,  o^) 


(A4c) 


Thus,  the  problem  is  to  find  £q(s)  such  that  |£o(juj)|  is  outside  the 

circle  C  in  Fig.  A1  for  and  to  the  right  of  the  line  s  =-o  for 

w  >  w..  It  is  obviously  very  easy  to  find  such  an  Z  (s)  which  also 
t  o 

has  all  its  poles  and  zeros  in  the  interior  of  the  left  half-plane, 
with  any  desired  finite  excess  of  poles  over  zeros,  and  which  further¬ 
more  has  the  property  shown  in  Fig.  Al,  i.e.,  lies  on  the  right  of 
Ss-o,  for  all  w.  For  example,  let 


21 


ox 


(l  +  — )  n  (1  +  —  ^ 

V  i  wi 


2*oxwt, 


e  any  desired  finite  number,  =  larger  of  (10cut,  — - — -),  w.+-j  =  100o^ 


Note  that  it  would  be  impossible  to  guarantee  the  existence  of  the  desired 
*o  ^  Pq  was  nonm^nimum~P*iase  (Horowitz  and  Sidi  1978). 


ii 


m  w 
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It  is  conceivable  that  even  though  A2(l)-A2(3)  are  satisfied, 

p 

A2(4)  is  not  satisfied.  Consider  the  zeros  of  1  +  pg  =  1  +  a  —  or 
P  ° 

°f  v+  V'  Reca11  that  in  [0’  wt1,{i^}  lies  in  the  circle  of  radius 
Yt  which  is  inside  the  circle  C  of  Fig.  Al,  while  lies  outside  the 

larger  circle  C.  In  °°),  lies  on  the  right  of  the  line  ss-  o 
while  ijjW  is  contained  in  V  of  Fig.  Al.  Also,  ^(ju)  lies  on  the 
right  of  s  =  -a,  Vw.  Hence,  the  vector  does  not  encircle  the 

origin  clockwise  (or  alternatively  does  not  so  encircle  jjft),  Vpef>, 
and  the  system  is  stable. 


In  the  mio  system  (4a),  the  loop  function  £uu  =  9UU/PUU  must  handle 

the  n  *uv  Problems  v  =  1 *2,. . . ,n.  The  bounds  on  £uuq  will  be,  in  general, 

different  for  each  v  with  its  own  loxy,  Ity  of  (A3)  and  oy  of  (A4c). 

Let  Iu  =  max  Itv,  «,Qu  =  max  £oxv»  ou  =  min  oy  be  the  design  parameters 

for  tUUQ.  Obviously  such  a  *uuo  is  satisfactory  for  all  n  t  problems. 

In  Sec  3  (just  before  3.1),  there  was  noted  the  desirability  of 

satisfying  (6)  on  the  boundary  of  a  semicircle  of  radius  in  the  right 

half-plane.  This  requires,  in  addition  to  the  previous,  rewriting 

Sec  A3,  replacing  jto  by  lo^e^9,  [0,  tt/2J.  The  development  is  easier  if 

o>H  is  large  enough  so  that  each  p^  =  k^/s  ^  on  s  =  .  Clearly, 

i0 

there  will  emerge  bounds  on  Jtuuo  on  s  =  wHeJ  ,  which  will  have  to  be 

satisfied,  in  addition  to  those  on  s  =  ju>.  Obviously,  such  bounds  can 

always  be  satisfied  by  suitable  shaping  of  JtUUQ  ,  so  that  I Auuol 

io 

large  enough  on  ^eJ  . 


There  remains  the  design  of  f (s ) ,  inasmuch  as  lQ(s)  =  g(s)  pQ(s) 
only  determines  g(s).  Mote  that  lQ[s)  only  guarantees  that 


sup  _ 

_C _ [ 

inf  p 
P  J 


—  +  l 
P  o 


f(s)  is  chosen  so  that  | t( jco) |  e  [A(w),  B{w)].  For  example,  suppose 

A(wj)  =  .9*  B(u>1 )  =  1.04,  and  at  ay  S^P|y- +  Jtj  =  100,  while  inf 

P  ^ 

“■  +  A0  =  90  with  |«.0(ju^)|  =  80.  The  range  of  |t(ju.)J  = 


i+. 


is  therefore  l-8|f (ju^ ) | ,  .889 1 f( jm ) |1 ,  so  we  need 


•  8|f(ju>j)|>.9,  .889|f(ju^ ) | <1 . 04 ,  giving  the  permissible  range  of 
[I*  ^889]  for  In  this  way,  the  bounds  on  |f(ju>)|  are 

found  and  it  is  always  possible  to  find  an  f(s)  with  left  half-plane 
poles  and  zeros  which  satisfies  such  bounds. 

The  above  procedure  in  all  its  details,  is  not  recommended  as  a 
practical  design  procedure.  Simplifications  were  made  to  make  the 
proof  easier,  but  the  loop  bandwidth  is  much  larger  than  necessary. 
Its  primary  purpose  is  as  an  existence  theorem.  A  practical  optimum 
design  procedure  based  on  these  ideas,  but  without  the  rigor,  has 
been  given  in  (Horowitz  and  Si di  1972)  and  used  a  great  deal  with 


considerable  success. 
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A5.  Extensions 

(1)  It  is  possible  to  have  A(w)  =  B(w),  Q(w)  =  0  in  A2(l),  (3) 
at  a  finite  number  of  u  values,  by  choosing  g  infinite  at  these  points. 
The  sensitivity  zeros  can  be  single  or  multiple. 

(2)  Some  or  all  pePcan  have  zerox  on  the  ju  axis.  If  these  zeros 
are  precisely  known  (unlikely),  g(s)  can  be  assigned  poles  there.  Other¬ 
wise,  t(jui)  must  be  zero  at  these  points  for  such  p,  requiring  obviously 
much  more  careful  statement  of  the  tolerance  on  t(jm)  and  td(jw)  near 
such  points. 

(3)  The  most  significant  extension  is  that  Constraint  Al(l)  can 
be  relaxed.  There  can  be  uncertainty  in  the  order  of  the  plant  due  to 
disappearing  poles  and  zeros— closely  related  to  the  problem  of  singu¬ 
lar  perturbations  (Porter  and  Tsingas  1978). 


A6.  Disappearing  Poles  and  Zeros 
Let 


m 

p  =  Pjlt  (l+saf ) 
n  (1+sbj) 


=  P^s) 


(A5) 


with  a..e[0,  a^J,  bj£[0,  bjx]and  p^e P satisfying  Al.  The  question  of 
concern  is:  "For  what  m,  n  values  can  the  loop  transmission  be  arbi¬ 
trarily  large  over  an  arbitrarily  large  bandwidth  but  still  be  practical, 
i.e.,  go  to  zero  as  w  -*•  «  with  any  desired  finite  excess  of  poles  over 
zeros?"  For  such  m,  n  any  tolerances  satisfying  A2  but  otherwise  ar- 
bitraryi  can  be  satisfied. 


r 


In  Fig.  2  and  using  (A5) 


t(s)  =  las _ =  fgpiy  _  H 

1  +  gp  1  +  gp.'i'  l  + 


(A6) 


The  question  posed  can  be  answered  by  referring  to  the  logarithmic 
complex  plane  (Nichols  chart)  in  Fig.  A2.  The  intersections  of  the 
zero  db  line  with  the  vertical  lines  (2n+l)  180°,  n  =  0  ±  1,  .  .  . 
is  the  point  -1.  Because  of  uncertainty,  £  =  gp^V  is  not  a  point  but 
a  set  {£}  denoted  here  as  the  template  of  £,  3^(w)  which  occupies 
some  region  in  the  complex  plane--Fig.  A2.  The  shape  of  3, 
that  of  {p-j  S')  because  there  is  no  uncertainty  in  g.  The  latter 
permits  the  translation  (but  not  rotation  of  £,)  in  the  complex 
logarithmic  plane,  horizontally  by  arg  g  and  vertically  by  |g|  in 
db.  For  some  finite  w  range,  large  |£|  is  needed  so  ^lies  above 
the  zero  db  line,  e.g.,  3^)  in  ^9-  A3*  At  large  enough  u,  |£| 
must  be  very  small  (->0  asur*»)  so  Q  must  be  well  below  the  zero  db 
lines  and  continue  downwards  to  -  In  the  transition  of  from 
above  to  below  the  zero  db  line,  it  must  not  interest  -1,  nor  en¬ 
circle  it.  Hence,  the  width  of ^  roust  be  restricted  to  <360° 
for  some  <o  interval  in  which  ^can  squeeze  in  between  two  -1  points 
on  its  way  downward  (Fig.  A£).  But  we  want  arbitrary  sensitivity 
reduction  for  arbitrary  bandwidth.  This  requires  3  w^,  ^  for 
cu  >  u>H  the  width  of  ^J(o)  <  360°. 


-----  ‘~ 


J  '*_j 
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Consider  now  the  shape  of  ^  which  is  that  ofj^  which  is 
that  of£7pl  in  the  Nichols  chart.  Constraint  A1  (3)  assures 
that  at  large  enough  w  the  width  of  -*■  zero  degrees,  so  it 

is  entirely  a  question  of  the  width  of  .  Consider  any  factor 

of  Y,  e.g.,  ^  +1jwb  ,  b  e  [0,  m] .  At  any  specific  w,  the  maximum 

width  of  the  template  is  tan"1  tab  =  tan"1  wm.  For  un  =  20,  the 

max 

template  is  OAB  in  Fig.  A3  (O  at  b  =  0,  B  at  ub  =  20);  for  tarn  =  100 
it  is  0ABU  and  for  iam  =  1000,  it  is  0ABUV.  For  two  such  independent 
factors,  it  is  easy  to  find  the  new  template.  This  is  done  in  Fig.  A3 
for  un.j  =  (jn^  =  20.  Draw  0"A"B"  =  OAB  and  position  0"  at  points  on 
OAB  (because  of  the  independent  uncertainties).  The  result  is 

ABEJDEF0  =  c7[tl:jui b1  ) (“Hjlb  ) 1  ’  ^2  1111  ’  The  temP^ate  of  a 

zero  factor  (1+jtaa)  is  obtained  by  reflecting  that  of  the  pole  if 

(“^max  =  (“*>)  max’  9iving  OA'B'  in  Fig.  3. 

As  ta  increases,  the  contribution  of  each  factor  (pole  or  zero)  •*»  90° 
in  width.  Therefore,  while  theoretically  four  factors  can  be  admitted 
between  two -1  points,  stability  margins  dictate  a  maximum  of  three. 

But  this  is  only  a  necessary  condition,  because  it  must  also  be  possible 
to  decrease  |L|  from  arbitrary  large  to  small  values.  This  basically 
means  that  over  arbitrary  large  frequency  range  Arg  L  must  be  over¬ 
whelmingly  negative.  The  extreme  right  side  of ^  must  then  lie  on  the 
left  of  the  0°  line  in  Fig.  A2.  One  disappearing  pole  or  zero  poses  no 
problem,  but  two  do  because  the  left  side  of  ^  will  then  intersect  -1 


- - - 


- 


be  made  rigorous,  of  course.)  Note  that  this  is  for  the  most  demanding 
situation.  If  only  stability  is  desired,  then  any  finite  number  of 
disappearing  poles  or  zeros  can  be  handled. 


APPENDIX  2 

A7.  CONDITIONS  THAT  <t»  MAPS  H(n2)  INTO  ITSELF 


The  constraints  on  Huv  were  given  in  2.1.  The  first  is  satisfied 
if  (6)  is.  From  Appendix  1,  it  is  seen  that  at  finite  w,  the  only 
possible  difficulty  is,  if  in  Fig.  2,  duv(jw)  is  unbounded  but  9uuPuve 
is  bounded.  If  such  unboundedness  of  duV  is  at  a  finite  number  of  u> 
values,  it  is  possible  to  assign  poles  there  to  gu(J.  Since  duy  is  a 
function  of  the  plant  parameters  (Eq .  4b),  an  infinite  number  of  such 
poles  is  conceivable,  in  fact  is  so  in  practice  if  there  is  one, 
because  of  inevitable  uncertainties.  How  can  dyV  be  unbounded  while 
puve  ’s  bounded?  From  (3»5) 


7  (-1)1U  A.  t. 

L  '  '  1U  iv 

.  _  _ 1?U _ _  A 

UV  '  A  =  y  (-1)1U  p.  A.  +  p  A  *  UVe  “  Auu 
/.  '  '  H1U  1U  Kuu  uu 

i^u 


(A7) 


Hence,  such  a  situation  is  possible,  if  A^u  has  such  a  pole  which  is 
cancelled  by  a  zero  of  p^u  and  is  not  present  in  Put|Auu  e.g.  n  =  2, 
p2j  has  a  pole  at  ±ja,  pl2  has  a  zero  there  and  p^P^  does  not  have 
a  pole  there.  Such  situations  are  therefore  not  allowed.  It  can  be 
argued  that  they  are  in  practice  impossible  (Horowitz  and  Shaked  1975), 


39 


because  P21  must  involve  different  physical  parameters  and  the 
uncertainties  in  each  cannot  be  100%  correlated.  Irrespective  of  this 
argument,  the  constraint  is 


I Pi j ( juj) |  is  uniformly  bounded  on  [0,°°)  and  M,  V  i/j  (A8) 

/ 

The  problem  is  more  difficult  as  cj  -*•  «  and  is  treated  in  Section  3. 

To  satisfy  constraint  (2)  on  Huv  in  2.1,  note  first  that  if 
z(jo))  «  Zj  +  jz2  with  z.,  z2  real  functions  of  u>,  then  | z |  ’  is  bounded 
if  z1  is  bounded.  For 


(  Zl  *  V '  ' 


'l  l 


U2Z2 


If  z 


is  bounded,  so  are  z|,  z2  and 


2  2 
2i  +  Z2 


1.1 

Z1  +  JZ2 


Consider  separately  (jia)  and 


^Tduv  ^  ’  Tbe  *ormer  can  be  written 


t' 


=  f' 


__L_  +  fCsP-’-jL-SlLpl 
1  +  i  0  +  gp)2 


(A9) 


of  Fig.  2.  Since  fJl/0+*)  is  bounded  by  the  appropriate  Buy,  the 
first  term  on  the  right  of  (A9)  needs  only  uniform  boundedness  of  f', 
which  is  easy  as  f  is  chosen  by  the  designer.  Obviously,  the  only 
possible  difficulties  with  the  second  term  of  (A9)  are  g',  p'  which 
can  be  infinite  only  at  ju  axis  poles.  However,  at  such  poles,  the 
denominator  forces  the  second  term  to  be  bounded.  At  large  ca  where 
9P»  g\  p*  0,  there  is  obviously  no  problem. 


Next,  consider  (Tduvduv)' (“>)  written  as 


(A10) 


+  d(p‘  -  q'p^) 

1+'9P  (l  +  gp)2 


9»P  of  (A9) ,  d  =  duv  . 


From  (A8),  d  and  since  d  is  a  rational  function  d',  are  uniUMuIy 
bounded  on  the  ju>  axis.  From  the  previous  discussion  re  p',  g*  etc.  and 
Appendix  1,  y'  can  be  uniformly  bounded  on  any  finite  u>  range  by  proper 
choice  of  g.  At  large  w  each  of  d,  d',  p,  p'  etc  -*■  0. 

It  is  easy  to  see  that  constraint  (3)  is  satisfied,  because  it  has 
been  required  that  the  elements  of  P,  G,  F  all  -*■  0  as  s  -*■  °°. 


t 


-  „ — 


..w,  . 
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Fig.  1  Multiple  input-output  two  matrix  degree-of-freedom  feedback 
structure  c  =  Tr,  T  =  [t...],  c  =  [C]  ...  cj1,  r  =  [r,  ... 


Pec  /6£L£ 


j  000/ — 


Lecture  notes: 


Methods  for  assessing  the  robustness  properties  of  a  linear 
multivariable  feedback  design. 


Ian  Postlethwaite , 

Control  and  Management  Systems  Division, 
University  Engineering  Department, 

Mill  Lane, 

Cambridge , 

England. 


Abstract 


On  completing  the  design  of  amultivariable  feedback 
system  it  is  always  desirable  to  be  able  to  predict  that  under 
certain  changes  the  system  will  remain  stable.  In  these  notes 
some  methods  are  described  for  determining  the  robustness 
properties  of  a  multivariable  feedback  system  under 
Ci )  simultaneous  variation  of  sensor  (or  actuator)  gains, 

(ii)  simultaneous  nonlinear  perturbations  of  loop  gains,  and 

(iii)  plant  parameter  uncertainty . 


1.  Introduction 


In  the  inverse  Nyquist  array  method*  for  multivariable 

feedback  design,  the  designer ,having  made  the  inverse  of  the 

open-loop  system  diagonally  dominant, can  by  examination  of  the 

open-loop  inverse  Nyquist  array  (with  Gershgorin  circles) 

determine  bounds  on  feedback  gains  for  stability . The  characteristic 

2 

locus  design  method  ,  although  a  procedure  which  does  not  require 
the  constraint  of  diagonal  dominance,  only  gives  stability  with 
respect  to  a  single  gain  common  to  all  the  loops.  But,  since 
low  interaction  and  accurate  tracking  are  main  objectives  of 
this  procedure  the  closed- loop  transfer  function  will  almost 
certainly  be  diagonally  dominant, and  in  Section  2  it  is  shown 
how  by  looking  at  appropriate  closed-loop  Nyquist  arrays  bounds 
can  be  obtained  on  sensor  or  actuator  changes  for  stability. 

This  is  a  technique  developed  and  implemented  on  the  Cambridge 
multivariable  design  package  by  Dr.  J.M.  Edmunds? 

In  Section  3  the  robustness  of  a  multivariable 
feedback  system  is  considered  under  simultaneous  nonlinear 
perturbations  of  loop  gains.  A  simple  interpretation  of  work 

4 

by  Mees  and  Rapp  provides  a  bound  on  the  nonlinear  perturbations 
for  stability  in  terms  of  principal  gains6. 

In  Section  4  the  problem  of  stability  under  plant 
parameter  uncertainty  is  discussed.  In  particular  it  is  shown 
how  recent  developments  in  the  complex  variable  analysis  of 
multivariable  feedback  systems6  can  be  used  to  determine  stability 
with  respect  to  any  system  parameter. 


2. 


2.  Closed-loop  Nyguist  arrays^ 

The  Nyquist  array  of  a  transfer  function  G(s)  is  formed 
by  drawing  the  Nyquist  diagrams  of  the  individual  elements  of 
G(s).  If  G(s)  describes  an  open-loop  system  then  the  array  is  called 
the  open-loop  Nyquist  array;  a  similar  diagram  for  G(s)~*  is 
called  the  inverse  Nyquist  array.  If  G(s)  (G(s)_1)  is  diagonally 
dominant  then  the  diagonal  elements  of  the  Nyquist  (inverse  Nyquist) 
array,  with  superposed  Gershgorin  circles^,  give  bounds  on  the 
simultaneous  variation  of  loop  gains  for  stability.  This  is  a 
well  known  result  due  to  Rosenbrock^  and  is  a  hi^ily  attractive 
consequence  of  the  inverse  Nyquist  array  design  method. 

The  characteristic  locus  design  method  is  atechnique 
which  does  not  require  the  constraint  of  diagonal  dominance 
but  as  such  only  gives  stability  with  respect  to  a  single 
gain  common  to  all  the  loops.  However,  the  main  objective  of  this 
approach  is  to  obtain  a  stable  closed-loop  system  with  low 
interaction  and  accurate  tracking,  and  so  the  closed-loop  transfer 
function  R(s)  will  almost  certainly  be  diagonally  dominant.  By 
forming  a  Nyquist  array  for  R(s) ,  called  the  closed-loop  Nyquist 
array,  and  drawing  Gershgorin  circles  on  the  diagonal-element, 
diagrams ,  bounds  can  be  obtained  on  simultaneous  variation  of 
sensor  gains  for  stability.  By  looking  at  a  similar  closed-loop 
transfer  function  bounds  can  be  determined  for  actuator  variations. 
These  methods  are  now  described.  •  ■ 

2.1  Closed- loop  configuration 

We  will  consider  the  configuration  shown  in  figurel  below. 


- ■  —  -  •  .  .. 


The  closed- loop  transfer  function  R(s),  is  given  by 


R(8)“[I-.+G«^»>G«<8>Ga<S>K<S)l  -1G„  (s  )  G  (s)G  (s)K(s) 

b  IU  S  p  a  J  S  U  a 


s  p  a 


and  if  K(s)  has  been  designed  succesfully  then  R(s)  will  be 
diagonally  dominant. 

2.2  Stability  under  simultaneous  changes  in  sensor  or 


controller  gains 

Consider  a  situation  where  feedback  is  applied  around 
the  closed-loop  system  via  a  real  diagonal  operator  F=diag{fi}; 
see  figure  2.  Then  from  the  diagonal  elements  of  the  closed- loop 
Nyquist  array  the  Gershgorin  circles  can  be  used  to  give  bounds 


on  the  f^  for  stability  . 


R(s) 


diag{  f  } 


Figure  2 


But  the  configuration  of  figure  2  is  equivalent  to  figures  3 


[t+diacM 


Figure  3 


I_+diag£f  31  (s) 


Gs(s 


Figure  4 

Consequently  the  bounds  on  the  f^  can  be  translated  into  bounds 
on  changes  in  sensor  or  controller1  stability  in  the  original 


Remark  1 .  Note  that  the  diagonal  elements  of  the  closed-loop 
Nyquist  array  (without  Gershgorin  circles)  give  exact 
information  about  system  stability  under  changes  in  a  single 
sensor  assuming  all  other  sensors  remain  unaltered.  To  see  this, 
suppose  that  we  are  interested  in  varying  the  jth  sensor  gain, 

i 

and  let  f^=0  for  all  i  except  i= j .  Then  we  see  from  figure  3 
that  we  have  a  single-input  single-output  problem  described  by 
the  j,jth  element  of  R(s) .  Stability  with  respect  to  f^  can 
therefore  be  determined  exactly  using  the  Nyquist  diagram  of 
the  j,jth  element  of  R(s)  which  is  the  j,jth  element  of  the  closed- 
loop  Nyquist  array. 

Remark  2 .  Note  that  the  Gershgorin  c  ircles  define  bands  within 
which  the  characteristic  gain  loci  of  R(s)  must  lie. 

2.3  Stability  under  changes  in  actuator  or  plant  gains 

For  the  closed-loop  system  shown  in  figure  1  consider 
a  new  input  and  output  between  the  actuators  and  plant  as  shown 
below  in  figure  5. 

Vs> 

Figure  5 

The  closed-loop  transfer  function  relating  i  (s)  and  #  (s)  is 

n  n 

given  by 

Rn(s)  =  [l  +  G  (s )  K  (s)  G  (s)  G  (s )1  -1G  (s)K  (s)  G  (s)  G  (s) 
n  ^  m  a  s  p  j  a  sp 

and  following  exactly  the  same  procedure  with  Rn(s),  as  with 
R(s)  in  the  previous  section,  bounds  can  be  obtained  on  changes 


in  actuator  or  controller  gains  for  stability.  These  bounds  will 
in  general  be  more  conservative  than  those  obtained  for  sensor 
variations  since  there  is  no  explicit  objective  in  the  design 
procedure  which  aims  to  make  Rn(s)  diagonally  dominant. 


Figure  6 


K(s)  —  controller  obtained  via  characteristic  locus  design  method 
G(s)  —  actuator,  plant  and  sensor  dynamics  combined 

The  characteristic  gain  loci  and  step  responses  are 
shown  in  figures  7-11,  and  the  open-loop  Nyquist  array  is  shown 
in  figure  12  from  which  it  can  be  seen  that  the  open  loop  system 
is  not  diagonally  dominant.  The  closed-loop  Nyquist  array  is 
shown  in  figure  13.  If  the  three  sensors  have  their  gains 
multiplied  by  k^,  k2 ,  and  respectively  then  the  Gershgorin 
bands  indicate  that  the  closed-loop  system  will  be  stable  if 

<  -0.48  or  0  <  k^  , 

k2  <  -0.43  or  0  <  k2  » 

and  0.33  <  k3  <  11. 

If  kj  <  -1.2  then  instability  will  definitely  occur. 


fliS  FtotO  x  too  ■ 
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The  closed- loop  Nyquist  array  for  actuator  variations 
is  shown  in  figure  14.  Because  the  actuator  dynamics  is  included 
in  G(s)  the  closed- loop  transfer  function  is  f*qm  an  input  and 
output  between  actuator  and  controller  and  not  between  plant 
and  actuator  as  described  in  the  theory.  An  extra  scaling 
pre- compensator  (1,0.001,0.01)  and  an  extra  scding  post¬ 
compensator  (1,1000,100)  have  been  added  because  of  the  different 
orders  of  magnitude  of  input  signals.  “£hi£  does  not  affect  the 
stability  since  in  the  closed  loop  these  operations  effectively 
cancel  each  other  out. 

If  the  three  actuators  have  their  gains  multiplied 
simultaneously  by  kal,  ka2 »  311(1  ka3  respectively  then  the 
Gershgorin  circles  indicate  that  stability  is  raintained  if 

2  >  kal  >  0.04  , 

ka2  <  or  °*12  <  ka2  , 

and  ka3  <  -0.24  0.02  <  k&3 

If  -0.24  <  ka3  <  -0.07 


then  instability  will  definitely  occur. 


3.  Stability  with  nonlinear  perturbations 


The  results  in  this  section  are  based  on  work  by 

4 

Mees  and  Rapp  which  in  turn  is  founded  on  the  small-gain 

0 

theorem  and  related  results  .  In  simple  terms  te  small-gain 
theorem  says  that  if  the  open- loop ' gain '  is  less  than  unity 
then  the  closed- loop  system  will  be  stable.  No  attempt  to  be 
rigorous  is  made  in  the  following. 

Consider  the  closed- loop  configuration  of  figure  1 
and  let  us  assume  that  associated  with  the  sensors  there  are 
some  nonlinear  perturbations  as  illustrated  in  figure  15  below. 


Assume  also  that  the  nonlinear  perturbation  is  diagonal 
i.e.  N ( . ) =diag (ni ( . ) ) ,  and  further  that  the  slope  of  n^[x^) 
is  bounded  below  by  -e^  and  above  by  as  illustrated  below. 

ni*xiV  ^^jslope  e± 


Figure  16 


slope 

It  is  also  required  that  N(0)=0, 

Figure  15  can  be  redrawn  to  give  the  figure  below 

1  1 


* 

s) 

m 

Ex 

s) 

G«(s) 


N(  .) 


H  (s) 


n  /c \ 


Figure  17 


and  applying  the  small-gain  theorem  to  this  we  have  that 


for  stability  H(s)  must  be  stable , which  it  is  by  design , 
and  the  gain  round  the  loop  must  be  less  than  unity.  To 
check  this  we  must  first  give  suitable  definitions  for  the  gains 
of  the  linear  and  nonlinear  operators. 

The  gain  of  the  linear  part  H(s)  can  be  defined  as 

sup  ||  H  ( jio)  || 

<t)>0 

where  ||a||  =  /(max.  eigenvalue  of  A^A) 

and  so  is  the  maximum  principal  gain^of  H(s). 

The  gain  of  the  nonlinear  part  will  be  taken  as 


max  {e . } 
i  1 


Consequently  the  inverse  of  the  maximum  principalgain  of  H(s) 
gives  an  upper  bound  to  the  slopes  of  the  nonlinear 
perturbations  for  stability  to  be  maintained. 

By  taking  a  slightly  different  definition  for  the 
gain  of  the  linear  operator  Il(s)  a  graphical  test,  analagous 
to  the  multivariable  circle  criteria  ,  can  be  obtained.  The 
resulting  bound  on  the  however  is  more  conservative;  this 
is  now  explained. 


At  a  particular  value  of  s 
H  =  RAR-1 


therefore  . 

II  H  U  =  ||  RAR”1 1| 

<i*n  ii  a  n  ii  r-1!! 


R — matrix  of  eigenvectors 
A — diagonal  matrix  of 
eigenvalues 


"  y  p 

where  y=  ||r||  ||  R  1||  is  the  ■square  reo4-  of  the  ratio  of  the 
largest  to  the  smallest  principal  gain  of  R,  and  p  is  the  largest 
eigenvalue  of  H.  Since  yp  is  an  upper  bound  on  ||  H  |  ,  thegain  of 
*  . . . ■  — ii'.  '  Oammmtit'rm  ~i  I 
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See  enclosed  paper  entitled  "A  note  on  parametric  stability". 
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A  NOTF,  ON  PARAMETRIC  STABILITY 
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ABSTRACT 

This  note  shows  how  recent  developments  in  the 
complex  variable  analysis  of  multivariable  feedback 
systems  can  be  used  to  determine  stability  with  respect 
ito  a  system  parameter. 


1.  Introduction 


A  feedback  system  is  said  to  be  stable  if  all  of  its 
closed-loop**' poles  ITfe  in  the  left  half-plane.  The  stability 
of  a  control  system  is  therefore  dependent  on  its 
associated  parameters.  Sometimes  in  a  control  system 
the  value  of  a  parameter  is  uncertain  perhaps  due  to  ageing, 
deterioration,  or  damage;  in  other  instances  it  may  be 
desirable,  for  economic  reasons,  to  change  a  parameter 
value.  In  both  these  cases  a  technique  which  predicts 
the  relative  stability  of  a  system  with  respect  to  a  given 
parameter  would  be  extremely  useful. 

A  dominant  theme  in  recent  research  on  complex  variable 
techniques  for  multivariable  feedback  systems  (MacFarlane 
and  Postlethwaite  1977;  MacFarlane,  Kouvaritakis  and 
Edmunds  1977;  Postlethwaite  1978),  has  been  the  association 
of  a  system  with  two  sets  of  algebraic  functions; 
characteristic  gain  functions  and  characteristic  frequency 
functions.  In  section  2  characteristic  'parameter' 
functions  are  introduced,  and  used  to  develop  the  ideas  of 
'parametric'  root  loci  and  'parametric'  Nyquist  loci  from 
which  the  relative  stability  of  a  system,  with  respect  to 
a  single  parameter,  can  be  determined.  To  help  in  assessing 
the  degree  of  stability,  generalizations  of  gain  and  phase 
margin  are  given  in  section  3.  The  ideas  are  demonstrated 
by  an  example  in  section  4.  In  the  concluding  section 
tentative  proposals  and  suggestions  for  future  research  are 
made. 


2.  Characteristic  frequency  and  characteristic  parameter 
functions 

The  feedback  configuration  considered  is  shown  in 
figure  1,  where  A (k2,k3, . .  .k^)  ,  B (k2,k3,  • .  •  /k^) , 

C(k2,k3, . . . ,kg)  and  D (k2/k3, . . . ,kg)  are  state-space 
matrices  which  are  dependent  on  (q-1)  real,  time-invariant 
parameters  and  k^  is  a  scalar,  time-invariant  gain  parameter 
common  to  all  the  loops. 


Figure  1.  Feedback  configuration  for  parameter  analysis 

The  closed-loop  poles  for  this  configuration  are  solutions 
of 

det  [si  -  S (k)  ]  =  0  (2.1) 

n 

where 

S (k)  =  A(k2, . . . , kg) — B (k2 , • . • ,k^) [kj  I^+D (k2 , • • • >^q) ) 

^ C  (k2 1  •  •  •  *kg) 

is, the  closed-loop  frequency  matrix  (Postlethwaite  1978).  1 

numerical  values  for  all  the  parameters  except  one,  say, 

are  substituted  into  equation  (2.1)  and  k^  considered  as 
a  complex  variable,  then  the  resulting  algebraic  equation 


(which  for  simplicity  of  exposition  will  be  regarded  as 
irreducible)  defines  a  pair  of  algebraic  functions  (Bliss 
1966)  s(kj)  and  k^  (s)  .  The  algebraic  function  s(k^)  is 
called  the  characteristic  frequency  function  with  respect 
to  kj,  and  the  algebraic  function  k^  (s)  is  called  the 
characteristic  parameter  function  for  k^.  (Note  that  the 
characteristic  frequency  function  s(g)and  the  characteristic 
gain  function  g(s),  introduced  by  MacFarlane  and  Postlethwaite 
(1977),  are  equivalent  to  s  (-k^  ^)  and  -k^(s)  ^  respectively) 


The  branches  of  s(kj),  for  k^  real,  clearly  define  the 
variation  of  the  closed-loop  poles  with  respect  to  k ^ ,  and 
as  such  are  termed  parametric  root  loci.  Alternatively, 
the  parametric  root  loci  can  be  viewed  as  the  0°  phase 
contours  of  k^ (s)  on  the  Riemann  surface  domain  for  k^  (s) , 
known  as  the  frequency  surface  for  k ^ . 


Dual  to  the  parametric  root  loci  are  the  parametric 

Nyquist  loci  or  characteristic  parameter  loci  which  are  the 

branches  of  k^  (s)  as  s  traverses  the  imaginary  axis. 

Alternatively,  the  characteristic  parameter  loci  can  be 

viewed  as  the  ±90°  phase  contours  of  s(kj)  on  the  Riemann 

surface  domain  for  s(k^),  which  will  be  called  the  parameter 

surface  for  k  . . 

-  1 


If  a  particular  system  has  a  set  of  nominal  parameter 
values  then  it  is  possible  from  the  set  of  parameter  surfaces 
to  determine  which,  if  any,  of  the  parameters  are  sensitive 
with  respect  to  stability.  To  help  in  such  an  assessment 
the  following  generalizations  of  gain  and  phase  margin  are 
introduced . 


The  ±90°  phase  contours  of  s('kj)  on  the  parameter  surface 

for  k_.  trace  out  the  boundary  between  stable  and  unstable 

closed-loop  poles  and  therefore  we  can  define  parameter  gain 

o 

and  phase  margins  for  k^  about  a  stable  operating  point  k^ 

which  give  a  measure  of  the  relative  stability  of  the  system 
with  respect  to  k^. 


Parameter  gain  margin.  Parameter  gain  margin  is  defined  with 

o 

respect  to  a  stable  operating  point  k.  as  the  smallest  change 

o  3 

in  parameter  gain  about  k_.  needed  to  drive  the  system  into 

instability.  Let  d^  be  the  shortest  distance  along  the 

o 

real  axis  from  a  stable  operating  point  k^  to  the  stability 
boundary  (characteristic  parameter  loci)  on  the  ith  sheet 


of  the  parameter  surface  for  k ^ .  Then  the  parameter  gain 

margin  is  defined  as  min  (d.  :  i=l,2,...,n> 

i  1 


Parameter  phase  margin.  On  each  of  the  n  sheets  of  the 

parameter  surface  for  k.  imagine  that  an  arc  is  drawn,  centre 

3  o 

the  origin,  from  a  stable  operating  point  k^  until  it  reaches 
the  stability  boundary  (characteristic  parameter  loci) .  Let 
be  the  angle  subtended  at  the  origin  by  the  corresponding 
arc  on  the  ith  sheet.  Then  the  parameter  phase  margin  is 
defined  as  min{<J>.:  i=l,2, . . .  ,n}  . 

4  1 


4 .  Example 

In  this  section  an  inverted  pendulum  positioning  system 


(see  figure  2)  is  considered  and  its  stability  analysed  with 
respect  to  one  of  its  parameters,  namely  the  mass  of  the 
carriage 


Figure  2.  Inverted  pendulum  positioning  system 


This  system  has  also  been  used  by  Kwakernaak  and  Sivan  (1972) , 
Cannon  (1967)  ,  and  El.gerd  (1967)  .  The  system  can  be  modelled 
by  the  following  linearized  state  differential  equation 
(Kwakernaak  and  Sivan  1972) . 


x(t> 


f — 

o 

o 

o 

x(t)  + 

'o 

o 

o 

*1 

o 

l 

M 

M 

0  0  O  1 

0 

1 

o 

trM 

O 

oiJ 

i 

0 
to  « 

u  ( t ) 


(4.1) 


where  u(t)  is  a  force  exerted  on  the  carriage  by  a  small  motor; 
M  is  the  mass  of  the  carriage;  F  is  the  friction  coefficient 
associated  with  the  movement  of  the  carriage;  and  L'  is  given 
by 

-  it  - -  ■  —  turn _ -  an - jjMjftai . 


(4.2) 


tj  s  J  +mL2 
mL 

where  m  is  the  mass  of  the  pendulum;  L  is  the  distance  from 
the  pivot  to  the  centre  of  gravity  of  the  pendulum;  and  J 
is  the  moment  of  inertia  of  the  pendulum  with  respect  to 
the  centre  of  gravity. 


The  system  is  stabilizable  using  state  feedback  of  the 

form 

u (t)  =  -Kx (t)  (4.3) 

and  using  the  numerical  values 

I  „  1  s”1 

M  A  s 

r  “  i^g"1  (4.4) 

2,  «  11.65  s'2 

L*  **  0.842m 

it  can  be  found  (Kwakernaak  and  Sivan  1972)  that 

K  =  [86.81,  12.21,  -118.4,  -33.44]  (4.5) 


stabilizes  the  linearized  system  placing  the  closed-loop  poles 
at  -4.706± j  1.382  and  -1. 902± j3 . 420  . 

We  will  now  look  at  the  parameter  surface  for  M  to  see 
how  variations  in  the  carriage  mass,  about  an  operating  point 
of  1kg,  affect  the  stability  of  the  system.  The  four  sheets 
of  the  mass  surface,  characterized  by  constant  phase  and 
magnitude  contours  of  s (M) ,  are  shown  in  figures  3-6,  from 
which  the  following  stability  margins  are  obtained: 


parameter  (mass)  gain  margin  =  1  kg 

parameter  (mass)  phase  margin  =  60° 

The  gain  margin  of  1kg  corresponds  to  reducing  the  carriage 

mass  to  zero  before  instability  occurs  and  the  phase  margin 
0 

of  60  indicates  adequate  damping  of  the  closed- loop  system. 

Sheets  3  and  4  of  the  mass  surface  are  characterized 
solely  by  left  half-plane  closed-loop  poles  whereas  sheets 
1  and  2  have  both  stable  and  unstable  closed-loop  poles 
separated  by  the  characteristic  parameter  loci.  The  crossings 
of  the  real  mass  axes  by  the  characteristic  parameter  loci 
determine  bounds  on  the  mass  for  closed-loop  stability 
analogous  to  the  way  in  which  the  characteristic  gain  loci 
can  be  used  to  determine  bounds  on  ^  (MacFarlane  and 
Postlethwaite  1977) ;  from  sheets  1  and  2  we  find  that  the 
closed-loop  system  has  a  'stable  mass  interval*  of  0  to  2.125  kg. 

5.  Conclusion 

AS  indicated  in  this  note  recent  developments  in  the 
complex  variable  analysis  of  multivariable  feedback  systems 
are  not  only  applicable  to  gain  and  frequency  but  any  system 
parameter  and  frequency.  In  particular  it  has  been  shown  how 
stability  with  respect  to  a  given  parameter  can  be  examined 
using  characteristic  parameter  loci  (generalized  Nyquist  loci) 
and, characteristic  frequency  loci  (generalized  Evans'  root  loci) 
viewed  on  their  appropriate  Riemann  surfaces.  To  obtain 
stability  results  in  terms  of  more  than  one  parameter  variation 
seems  to  be  a  much  more  complicated  problem  but  one  with  great 
practical  significance.  It  is  felt  that  such  results  might 


complex  variables. 

It  is  also  thought  that  the  parameter  surfaces  may  prove 
to  be  useful  in  the  design  of  parameter-dependent  controllers 
for  systems  in  which  a  particular  parameter  suffers  large 
variations  during  normal  operation.  For  example,  the 
controller  of  an  aircraft  engine  needs  to  operate 
satisfactorily  over  a  wide  range  of  altitudes.  A  possible 
design  scheme  could  be 

(i)  to  design  real  constant  controllers  at  a  number  of 
altitudes, 

(ii)  to  obtain  an  altitude  dependent  controller  by  "matrix 
interpolation",  and  finally 

(iii)  to  analyse  the  stability  of  the  system  over  the  whole 
working  range  using  an  "altitude  surface". 
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A  ROBUST  CONTROL  SYSTEM  DESIGN* 
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Abstract 

A  representation  of  controllable  linear  systems  Is  Introduced,  which  permits  assigning  poles  or  charac¬ 
teristic  parameters  to  a  state  feedback  system  by  a  matrix  multiplication.  This  Is  used  as  a  link  between 
state  space  and  classical  parameter  plane  methods.  The  system  representation  maps  a  point  In  a  n*p  dimen¬ 
sional  parameter  space  9  of  characteristic  parameters  into  the  nxp  dimensional  parameter  space  \  of  state 
feedback  gains,  where  p  is  the  number  of  actuators.  For  pal  the  coordinates  of  the  9  space  are  the  coef¬ 
ficients  of  the  closed  loop  characteristic  -olyuomial ,  for  p>l  they  are  coefficients  In  a  characteristic 
polynomial  matrix  and  its  determinant  is  the  characteristic  polynomial.  By  this  computationally  simple 
mapping  procedure  it  becomes  feasible  to  map  not  only  a  fixed  set  of  eigenvalues  but  also  regions  in  the  s 
or  z  plane,  In  which  the  eigenvalues  shall  be  located.  This  relaxation  of  the  dynamic  specifications 
permits  satisfying  other  typical  design  specifications  like  robustness  with  respect  to  sensor  and  actuator 
failures,  large  parameter  variations,  finite  wordlength  implementation,  and  actuator  constraints.  All 
tradeoffs  between  such  requirements  can  be  made  in  the  X  space.  Three  examples  illustrate  Che  variety  of 
problems  which  can  be  cackled  with  this  new  tool. 


1 .  INTRODUCTION 

Control  system  specifications  are  usually  not  given 
in  terms  of  a  quadratic  cost  function  or  a  set  of 
eigenvalues.  These  are  mainly  used  as  free  para¬ 
meters  in  trial  and  error  design  procedures  aimed 
at  good  tradeoffs  between  the  dynamics  of  the 
system  and  other  design  aspects,  for  example 
actuator  limitations  and  robustness  with  respect 
to  sensor  or  actuator  failures  or  other  large 
parameter  variations.  Three  questions  in  this 
context : 

1.  Quadruplex  techniques  (for  example  in  aircraft 
control  systems)  are  an  expensive  solution  to 
the  reliability  problem.  Is  it  not  sufficient 
to  guarantee  that  all  unstable  and  insuffi¬ 
ciently  damped  modes  remain  observable  and 
controllable  under  all  considered  combinations 
of  sensor  and  actuator  failures? 

2 .  Which  system  changes  are  so  essential  that 
they  require  adaptation  of  the  control  system 
by  identification,  failure  detection  etc.? 
Which  range  of  such  changes  can  be  covered 
satisfactorily  by  fixed  gain  feedback  or  a  few 
sets  of  gains  and  a  simple  switching  criterion. 

3.  Is  a  given  set  of  mixed  specifications,  e.g. 

on  bandwidth  and  damping,  actuator  constraints, 
robustness  requirements,  etc.,  compatible 
within  an  assumed  control  system  structure,  or 
which  of  the  specifications  are  conflicting, 
how  far  do  we  have  to  relax  them? 

This  paper  does  not  give  a  complete  answer  to  these 
questions ,  however  a  method  is  proposed  and  some 
tools  are  provided  to  attack  such  questions  under 
the  following  assumptions: 

1.  Only  linear  plants 

x  “  A x  +  B u  x  *  [x1- ..xnl  ' ,  u  -  [up  .  .up]  '  (1) 

or  x(k+l)  *^x(k)  +  B  u(k)  are  considered.  It 
is  assumed  that  eq.  (1)  is  written  in  "sensor 
coordinates,"  l.a.  all  measured  variables  are 
state  variables  xg.  Several  pairs  (a^.Bi), 

(A2 .Bj ) ,  etc.  may  be  given,  e.g.  for  different 
operating  points  of  an  underlying  nonlinear 
system.  It  is  assumed  that  all  pairs  (Ag.Bg) 
are  controllable  and  have  the  same  control¬ 
lability  indices. 


2.  The  price  of  an  actuator  is  assumed  to  increase 
with 

ut  ■  max|ui(t)|  and/or  (2) 

»  max|  (t)|  (3) 

where  the  worst  initial  state  within  given  limi¬ 
tations  is  considered,  u,  and/or  u,'  should  be 
kept  "small." 

3 .  A  state  feedback  structure 

u  -  -K'x  (4) 

is  assumed.  The  details  and  examples  are  worked 
out  for  single  input  plants  with 

u  *  -k'x  -  k2  ...  kjx.  (5) 

For  multi-input  plants  the  basic  result  is 
stated  in  the  Appendix.  The  nxp  elements  of  K' 
are  the  free  parameters  of  the  proposed  method. 
They  are  coordinates  of  a  parameter  space 
called  "state  feedback  gain  space"  or  "V-space." 

4.  It  is  assumed  that  sensor  and  actuator  failures 
occur  in  the  form  that  the  output  of  a  failed 
element  is  not  correlated  to  its  input.  Then 
the  output  is  an  external  disturbance.  Rejec¬ 
tion  of  external  disturbances  is  not  considered 
in  this  paper.  For  the  closed  loop  system 

x  -  (A-BK')x  (6) 

in  sensor  coordinates  a  failure  of  the  1th 
sensor  (actuator)  is  equivalent  to  a  structural 
change  by  which  the  1th  column  (rw)  of 
becomes  zero.  Also  in  the  case  that  a  stata 
variable  is  not  measured,  the  corresponding 
coltan  of  JC ’  is  zero.  It  is  part  of  the  design 
to  decide, which  state  variables  are  measured 
and  for  which  of  them  redundancy  must  be  pro¬ 
vided  for  high  system  reliability.  It  is  a 
goal  to  avoid  failure  detection  and  multiplexed 
components  whenever  possible. 

5.  It  is  assumed  that  the  nominal  dynamic  behavior 
of  the  control  system  can  be  specified  by  a 
region  in  the  eigenvalue  plane -e.g.  for  a  con¬ 
tinuous  time  system  in  the  s  plane  the  region 
to  the  left  of  the  boundary  marked  with  p*l  in 
Fig.  1  -whera  all  eigenvalues  must  be  located 
for  the  nominal  structure  and  parameter  values. 
For  failure  situations  a  relaxed  "emergency 
specification,"  e.g.  the  boundary  0*0.5  or  the 
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Fig.  1.  A  family  of  hyperbolic  boundaries  in  s 
p lane . 

stability  limit  Pa0  in  Fig.  1  may  be  given. 

A  specification  is  robust  under  a  failure  if 
no  eigenvalue  crosses  the  corresponding 
boundary  due  to  the  failure. 

The  proposed  method  is:  Design  in  Y-space.  A 
region^  in  the  Y-space  is  determined,  such  that 
all  eigenvalues  meet  the  specifications  iff  K'SYi' 
This  may  be  the  intersection  of  several  such 
regions  for  different  parameter  values.  Subsets 
of  Y^  with  certain  robustness  properties  can  be 
found  and  tradeoffs  with  actuator  constraints, 
bandwidth  requirements,  etc.  can  be  made  in  the  Y- 
space.  The  method  also  shows,  whether  a  solution 
exists  under  the  given  assumptions  and  if  not, 
which  alternatives  exist  for  relaxation  of  speci¬ 
fications  such  that  a  soludon  will  exist. 

Parameter  space  methods  have  a  long  tradition, 
mainly  in  Russia  and  Yugoslavia.  Siljak  [11  gives 
a  historical  review  of  the  work  by  Vlshnegradsky , 
Neimark,  Mltrovic,  and  others.  Siljak  generalized 
these  parameter  mapping  methods  significantly.  A 
typical  procedure  for  a  continuous  time  system  is 
to  assume  a  controller  structure  with  two  free 
parameters  or  and  3.  Determine  the  closed-loop 
characteristic  polynomial 

P(s)  -  i|)Pi(a,,0)si-0.  (7) 

Substitute  s  ■ff+jm  and  separate  eq.  (7)  into  its 
real  and  Imaginary  parts:  Re(a,u),ar,3)a0, 
Im(<J,u),or,9)“0.  Assume  these  nonlinear  equations 
have  a  solution 

or  -  ar(o,u)),  9  -  B(o,ui).  (8) 

Equation  (8)  allows  to  map  tj,u)  pairs  on  the 
boundary  into  the  or-8 -plane.  The  image  boundaries 
divide  the  cr-9-plane  into  regions  characterized  by 
the  number  of  eigenvalues  inside  and  outside  the 
s -plane  region. 

In  the  present  paper  the  control  system  structure 
is  restricted  to  state  feedback.  This  remits 
simplifying  the  determination  of  eq.  (8)  by  pole 
placement  methods.  Consider  for  example  a  second 
order  single -input  system  vlth  k1aor,  k2a8  in  eq. 
(5).  In  classical  parameter  plane  methods  P(s)a 
det(s£-4"rt>  k')“P0(af,8)+Pi  (or,8)s+s^a0  is  determined 
and  with  9ad+ju>  solved  for  a  and  8.  In  the  method 
proposed  in  this  paper  the  p*  are  expressed  in 


terms  of  ?  and  oo  by 

P(s)  »  (s-7+ju>)(s-CT-jaj)  a  s^-2osdo^4u>^ 

*P0<3.“)  d-Pjlcfjs+s2 -0.  (9) 

Then  by  pole  placement 

kl  “  ®<P0>Pl)  " 

k2  -  SCPo.Pp  -  8  (cr, in).  (10) 

Thus  the  mapping  equation  (8)  is  obtained  in  a 
different  way.  More  generally  for  an  nth  order 
single  input  system  in  both  approaches  an  a  dimen - 
s  tonal  parameter  space  9  with  coordinates  p1  is 
introduced  as  an  intermediate  step  between  the  set 
of  eigenvalues  Aa[x1  . . .  X„}  and  the  Y- space.  The 
relation  between  A  and  X  can  be  expressed  in  both 
directions : 

a)  From  X  to  9  by  the  characteristic  equation 

P <X  )"det  (X  I-ATbk1 ) ,  from  9  to  A  by  numerical 
factorization  of  P(X). 

b)  From  A  to  9  by  multiplication  of  elementary 
factors  P(X)a(X-Xi)CX*X2)'-*^'^n)>  from  9  to 
X  by  pole  placement. 

In  the  next  section  pole  placement  is  formulated 
in  a  form  which  makes  direction  b)  far  more  attrac¬ 
tive  than  direction  a).  In  Section  3  the  use  of 
such  boundaries  for  the  design  of  robust  control 
systems  in  Y-space  is  discussed.  Section  4  shows 
the  application  to  three  examples. 

2.  BOUNDARY  MAPPING 

Pole-placement  for  single-input  systems.  The  pole 
placement  theorem  is  used  in  the  form  originally 
published  in  German  in  [2l,  available  In  English  la 
[31  :  Given  an  nth  order  monic  polynomial  P(X),  an 
nxn  matrix  4  and  an  nxl  vector  b  such  that  detR^O, 
Ra[b,^b  ...  An-1b)  ,  the  equation  P(X)a 
det(X"l-4+b  k1)  has  a  unique  solution  and  this  solu¬ 
tion  is 

k'  -  e'P(A)  (11) 

where  e'  is  the  last  row  of  R”^. 

With  Pa)  -  (X-11)(X-X2)  ...  f\-Xn)  (12) 

-po+PlX  +•••  +Pn.1Xn'1+Xn  (13) 

eq.  (11)  may  be  written  as 

k'  -  e'  (A-Xjl)  (A-\2I)  •  •  •  (4-^nD  <l4> 

“£.'  (P0I  +  Pj4+  •  •  •  +Pn-i&n  l+4n)-  <15> 

For  mapping  from  9  space  to  X  space  it  Is  more  con¬ 
venient  to  rewrite  eq.  (15)  as 

-e'e  _  .  „ 


E  is  an  (n+l)xn  matrix.  If  the  inverse  of  eq.  (16) 
is  needed ,  it  is  convenient  to  express  the  last 
row  of  £  by  the  Cayley-Hamilton  theorem  in  terms 
of  the  previous  rows.  This  however  requires  the 
evaluation  of  the  characteristic  polynomial 
det  (\I-A)  •  a  +a.\  +  . . . +an_lXn_1"Hn.  The  inver¬ 
tible  form  of  eq.  (16)  is 

e 1 

"!po‘®0  Vi  vr'n-i'i1-  W*1'1;'4 


The  columns  of  W  can  be  evaluated  recursively  by 
Leverrler's  algorithm,  which  also  gives  the  a^  [2] . 


The  fora  (16)  la  most  convenient  for  trial  and 
error  design  procedures,  graphical  displays  of 
cross-sections  of  the  X  space,  etc.  The  plant 
description  in  the  form  of  the  matrix  E  is  evalu¬ 
ated  only  once  for  a  given  pair  (A,b) .  The  map¬ 
ping  of  a  trial  design  point  in  J  space  then 
requires  n2  multiplications  and  n 2  additions.  This 
compares  favorably  with  mapping  a  trial  design 
point  from  the  parameter  space  of  quadratic 
criteria  via  the  Riccati  equation  into  X  space. 

The  generalization  of  eq.  (16)  to  multlinput 
systems  is  given  in  the  Appendix. 


Sensitivities .  The  influence  of  a  coefficient 
of  the  characteristic  polynomial  on  k' ,  given  the 
other  p, ,  follows  from  eq.  (16)  as 
3  dk'  ,  i 

3*-  *  l'4\ 

dpi 


(18) 

The  influence  of  an  eigenvalue  on  k',  given  the 


other  X 


j’ 


^■-e'(A-XiD 


follows  from  eq.  (14)  as 

(&"x  i-ii)  •  •  •  (4‘xnD 


For  complex  conjugate  eigenvalues  quadratic  factors 
in  P(s)  are  more  convenient.  Let  P(X)" 
(a-H>\-Hi2)Q(X),  then 


k'  -e'(al  +  bA+A  )-Q(A) 


ikL 

da 


(20) 

(21) 


Regions  in  )  plane.  Boundaries,  symmetric  with 
respect  to  the  real  axis,  in  the  X  plane  will  be 
specified,  which  describe  the  desired  eigenvalue 
locations.  Two  cases  will  be  discussed:  A  real 
root  crossing  a  boundary  or  a  complex  conjugate 
pair  crossing  a  boundary.  The  third  possible  case 
of  roots  leaving  the  region  through  infinity  can 
be  avoided  by  closing  the  contour  by  an  arc  of  a 
circle  with  large  radius.  Typically  the  region  is 
a  connected  set  and  the  boundary  has  two  inter¬ 
sections  with  the  real  axis.  In  this  case  there 
are  two  real  root  boundaries  and  one  complex  root 
boundary  in  X  space.  However  other  boundaries  are 
possible,  e.g.  separate  boundaries  for  slow  and 
fast  modes,  etc.  For  each  intersection  of  a 
boundary  in  the  X  plane  with  the  real  axis  at 
a  real  root  boundary  in  X  space  is  obtained  from 

P(X)  -  (X -<J)R(X ) ,  R(X)  *  r+r,X  +  ••  •  +r  ,X°  2+Xa  1. 

(22) 

By  eqs .  (16)  and  (22)  v ’ 

ki*ki(P0  pn-l)*,Cl(Cr>ro  •••  cn-2)  i“1-2-'n  <23> 

where  the  kt  depend  linearly  on  a.  Thus  a  can  be 
eliminated  by  one  of  the  kj/s  to  give  the  linear 
boundary 

kj -k  (kj.r,,  ...  rn.x)  1-1,2 . n,  jl*i.  (24) 

This  is  a  straight  line  in  the  k^-k.  plane. 

Another  part  of  the  boundary  is  obtained  if  a 
complex  pair  of  elganvalues  crosses  the  boundary 
at  \  "o+jui.  Then 

P(X)-(X2-2<tX+o2+op2)<)(X)  (25) 

Q(x> *q0  +qjX  +•••  +  V.3xI1  3  +>R  2 

and  the  type  of  boundary  in  X  space  depends  on  the 
form  of  the  boundary  at  “  s (o )  in  the  \  plane.  For 
<r -const.,  i.e.  a  parallel  to  the  imaginary  axis, 
the  kt  are  linear  in  is2.  Thus  for  given  qt  the 
image  in  the  X  space  is  a  straight  line. 

Most  commonly  used  boundaries  are  conic  sections 
symmetric  to  the  real  axis,  i.e. 

jj2  ■  c  +c,»‘fc,<T  .  (26) 

Special  cases  are 


c.  <0  ellipse,  of  particular  interest  are  circles 
2  cj"-l ,  e.g.  constant  natural  frequency  curves 
in  s  plane,  stability  limit  and  ocher 
boundaries  in  z  plane. 

Cj“0  parabola,  or  if  also  c^“0,  ^>0  straight  line 
parallel  to  the  real  axis. 
c2  >0  hyperbola,  in  particular  2  straight  lines  for 
uj2“c2  (au0)>  c2>0,  e.g.  constant  damping 
lines  in  s-plane. 

Figure  1  shows  the  fasiily  of  hyperbolas 

u,2  .  -p2+,2/p2.  (27) 

For  o-O  this  goes  to  the  imaginary  axis,  for  P“1 
the  asymptotes  are  the  1A/2  damping  linei.  For  a 
different  scaling  a  may  be  replaced  by  o/d. 
Substituting  eq.  (26)  into  (25) 

Pa)  -IX2-2o\+(1-*:2)<t2  d-c^  +cQ)Qa).  (28) 

This  shows  that  the  p,  and  I4  depend  linearly  on  a 
for  c«*-l,  i.e.  for  circular  boundaries.  Thus  also 
in  this  case  the  boundaries  in  X  space  are  straight 
lines  if  the  eigenvalues  in  Qa)  are  fixed  and  a 
complex  pair  of  poles  moves  along  the  circle. 

For  c,]*-l  the  functions 

Pi-PiH  -W  (29) 

are  quadratic  in  a  and  by  eq.  (16)  the  same  is 
true  for 

kl  -  kl(a.q0  ...  qn.3).  (30) 

One  of  these  equations  can  be  solved  for  a^j(k,), 
where  only  real  roots  c“v+6  are  of  interest,  if 
only  the  left  half  X  plane  branch  of  the  conic 
section  is  needed,  than  o“Y-S  is  selected  and  sub¬ 
stituted  into  the  other  k^  equations  to  give 

V^l-’o  "•  V3)l  ***'  <31) 

Note  that  this  is  not  the  curve  in  the  k,-k.- 
cross- section  of  the  X  space,  which  would  be 
obtained  for  k  “const . ,  m^l , j ;  eq.  (31)  gives  Che 
curve  k.  (k,)  for  constant  q_.  - -qn.v  P°t  the 
numerical  determination  of  boundaries  in  cross- 
sections  of  the  X  space  the  implicit  form  (30)  is 
more  useful.  It  gives  o-values  as  a  parameter 
along  the  boundary.  Constant  damping  spirals  in 
the  z  plana  are  not  conic  sections.  Usually  they 
are  supplemented  by  a  condition  |z|  <a,  a<l.  The 
resulting  regions  can  be  reasonably  well  approxi¬ 
mated  by  a  family  of  nonintersecting  circles 

(v-v  )2 +w2  “  r2,  z  “  v  +  jw 
v  (v°-l)  -  0.99r(r-l)  ,  vQ<  0.5.  (32) 

It  is  shown  in  Fig.  2.  For  r“l  it  is  the  unit 
circle, with  decreasing  r  the  center  vq  of  the 
circles  moves  to  the  right  until  it  reaches  0.45 
for  r*0.5,  it  then  goes  back  to  zero,  where  vQ“r“0 
is  the  deadbeat  solution. 

Regions  in  X  space.  Equations  (22)  and  (25)  show 
that  the  mapped  boundaries  in  Xf  space  represent  the 
conditions  under  which  the  number  of  eigenvalues 
inside  and  outside  a  X-region  can  change.  These  X- 
boundarlas  partition  the  X  space  into  regions;  each 
of  them  corresponds  to  a  fixed  number  of  eigen¬ 
values  inside  the  X  region,  and  it  must  be  decided, 
for  which  X  region  all  eigenvalues  are  inside  the  X 
region.  For  closed  contours  in  the  X -plana  the 
region  is  bounded,  sinca  by  eq.  (16)  no  kj.  can  go 
to  infinity.  If  there  are  several  bounded  regions, 
a  simple  test  is  to  check  the  eigenvalues  for  an 
arbitrary  K'  in  the  considered  X  region.  An  alter¬ 
native  are~Sll)ak's  "shading  rules"  for  the 
boundaries  [ 1] . 

Consider  a  second  order  system  and  a  circular  X- 
region.  Boundaries  in  the  k^ -k2 -plane  are  three 


straight  lines  obtained  for  the  two  real  root  ca9es 
and  '."a 2  an<*  oae  coa,Pl®x  root  case.  They  par¬ 
tition  the  X  plane  into  seven  regions  with  the  pro¬ 
perties:  no  pole  outside  the  circle,  one  left,  tvo 
left, one  right,  two  right,  one  left  and  one  right, 
complex  outside.  The  only  bounded  region  is  the 
triangle,  thus  for  ki.kj  in  the  criangle,  \;  and  \2 
are  inside  the  circle.  At  the  vertices  ot  the  tri¬ 
angle  both  poles  cross  boundaries  simultaneously. 
This  is  the  case  for  1)  a  double  pole  at  tj,  2)  a 
double  pole  at  and  3)  one  pole  at  and  one  at 
a2.  Thus  the  total  mapping  procedure  consists  of 
just  three  pole  placements,  l.e.  twelve  multiplica¬ 
tions  and  twelve  additions.  This  makes  it  easy  to 
map  the  family  of  circles  of  Fig.  2.  If  the  circle 
is  deformed  to  a  different  closed  contour  with  the 
same  real  axis  intersections  at  3^  and  c2,  Chen  the 
three  vertices  and  two  edges  of  the  triangle  remain 
unchanged,  the  third  edge,  l.e.  the  complex  root 
boundary,  is  replaced  by  a  curve.  For  a  third 
order  system  and  a  circular  1-region  the  two  real 
root  boundaries  are  planes.  The  complex  root 
boundary  for  a  fixed  real  pole  in  a  straight  line. 
By  moving  the  real  pole  the  straight  line  moves  and 
forms  Che  third  surface.  The  4  vertices  of  the 
region  are  again  obtained  by  pole  placement  of  che 
four  characteristic  polynomials  with  zeros  in  the 
set  [ctj.Jj}.  For  the  corresponding  region  in# 
space,  Fam  and  Meditch  [4]  have  shown  Chat  the 
convex  hull  of  the  region  is  the  tetrahedron  with 
the  above  mentioned  vertices.  By  the  linearity  of 
the  mapping  equation  k this  property  does  hold 
in  the  space  also.  Similarly  for  arbitrary  n 
from  14]  follows:  The  convex  hull  ot  the  X  region, 
for  which  all  eigenvalues  are  located  inside  a 
circle  with  center  on  the  real  axis  and  inter¬ 
secting  che  real  axis  at  ox>a2’  ls  a  polyhedron 
with  n+1  vertices.  They  can  be  obtained  by  pole 
placement  for  che  n+1  characteristic  polynomials 
with  zeros  in  the  set  [ffi.Sj}*  The  two  real  root 
hyperplanes  are  two  of  the  surfaces  of  the  poly¬ 
hedron. 

3.  DS'SIGM  IMy  SPACE 

Robustness  with  respect  to  sensor  failures.  A 
specification  is  "F^-robust"  if  it  remains  satis¬ 
fied  after  a  failure  of  sensor  i.  It  is  "Fj,- 
robust"  if  the  same  holds  after  failures  ofooth 
sensors  1  and  j.  Fig.  3  shows  an  example  of 


Fig.  3.  Illustration  of  failure  robustness  and 
emergency  boundaries . 

boundaries  in  the  k^-k2-subspace.  It  is  assumed, 
that  all  other  feedback  gains  are  fixed.  The  pro¬ 
jection  of  point  1  on  the  k|  axis  ls  outside  the 
energency  region,  i.e.  the  emergency  specification 
is  not  F2 -robust,  it  is  however  F^  robust.  Points  2 
and  3  are  F^  and  F2  robust.  Mo  point  is  Fj2  robust 
since  the  origin  k,*k,«0  lies  outside  the  emergency 
region.  Point  3  also'meets  the  nominal  specifica¬ 
tion  and  is  a  good  candidate  for  a  robust  control 
system.  Since  the  nominal  boundary  Intersects  the 
k2  axis,  an  alternative  to  the  robust  solution  3  is 
to  eliminate  the  x,  sensor  and  to  multiplex  che  x2 
sensor.  This  would  maintain  che  nominal  specifica¬ 
tions  under  a  failure  ofone  of  tha  x2  sensors. 
However  it  requires  failure  detection  with  at  least 
three  x2  sensors  and  very  likely  is  the  more  expen¬ 
sive  solution. 

Robustness  with  respect  to  actuator  failures. 

Assume  k2  and  k2  in  Fig.  3  are  elements  of  different 
rows  of  the  feedback  matrix  K'  In  eq.  (A. 8).  Then 
the  same  arguments  as  above  apply  for  the  robust¬ 
ness  of  specifications  with  respect  to  actuator 
failures . 

Robustness  with  respect  to  large  parameter  varia¬ 
tions  ■  Assume  that  for  different  operating  condi¬ 
tions  different  pairs  (Aj.,Bi),  (A2,B2>  etc.  are 
given.  One  boundary  in  the  eigenvalue  plane  now 
maps  into  different  boundaries  in  X  space,  and  it 
must  be  tested,  whether  there  exists  an  intersec¬ 
tion  of  che  admissible  regions.  If  it  does  not 
exist,  then  ac  least  a  gain  scheduling  system  can 
be  designed,  in  which  each  gain  covers  as  many  oper¬ 
ating  conditions  as  possible. 

Robustness  with  respect  to  finite  wordlength.  The 
feedback  control  law  may  be  Implemented  approxi¬ 
mately  in  a  short  wordlength  microprocessor  as 

u«u-  (K'+AK' )  (x+Ax)«£'i  +  A£.,x +K’A&.  (33) 

For  small  x  the  dominant  term  in  Au  ls  K'Ax,  l.e. 
the  gains  should  be  not  too  high.  For  large  x  the 
dominant  term  Is  AK'x.  The  maximally  Aj('  robust 
solution  is  the  center  of  che  largest  hypercube 
with  edges  parallel  to  the  axes  ir  the  admissible 
V-region  Fig.  4  illustrates  AK'  robustness. 
Actuator  constraints.  Constraints  on  u“max|u(t)| 
and  u*maxiu(t)|  can  be  treated  in  V  space.  For  che 
regulator  problem 

|u(t)|  *  |k'x(t)|  s  l|kjH!x(t)||  (34) 

with  equality  for  the  worst  case  of  x(t)  (e.g., 
x«ck  for  some  0*0).  Assuming  that  all  state  vari¬ 
ables  have  been  normalized  Co  Chair  maxiaum  value, 
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the  norm  y  .  (35) 

i.e.,  the  distance  iron  the  origin  in  X  space  can 
be  used  as  a  measure  for  u«max|u(t)| .  Similarly 
|u(t)|  *|k'x(t)l  "  Ik’ (firbk' )x(t)| 
and  lik' C4*b  k' )||  can  be  used  as  a  measure. 

4.  .EXAMPLES 

The  following  three  examples  of  second,  third,  and 
fourth  order  show  various  typical  design  aspects 
and  solutions  in  X  space  using  the  tools  intro¬ 
duced  in  this  paper.  All  calculations  were  done  on 
a  programmable  pocket  calculator. 

Second  order  discrete  system. 

x(k+l)-Ax(k)+bu(k).  *£j,  (36) 

Find  u“-[k3  kjlx  such  that 

i)  stibility  is  F^-robust  and,  if  possible,  also 
Fj-robust, 

ii)  the  system  remains  stable  for  u*-(fc]+Ak,k2+Ak]  - 
with  the  maximum  4k.  r 
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k'  -fc'E-lp  p.  1) 


(37) 


The  vertices  of  the  stability  triangle  in  the 
k3-k2 -plane  are  determined  by  3  pole  placements 

1.  P(z)  -  (z+1)2 -z2«zH,  k'-Ul  6] 

2.  P(z)  «  (z+l)(*-l)  *z2-l,  k’-l-l  -14]  (38) 

3.  P(z)  -  (z-l)2*22-2z+l,  k' «[-3  -10). 

In  Fig.  4  it  is  seen  that  the  requirements  for  F3 
and  Fj  robustness  are  not  compatible,  the  F^  robust 
region  is  chosen,  li)  requires  to  place  the 
largest  square  with  sides  parallel  to  the  axes  into 
the  F,  robust  region.  It  has  the  eenter 
k'*[ -0.454545  -10.727272]  and  permits  Ak-1. 454545. 

This  k'  places  the  eigenvalues  at  Zj*0.132, 

22*0.686. 


-  Fi  Robust 

'Moximolly  Ak- Robust 

Fig.  4.  Second  order  system:  A  circle  maps  into  a 
triangle.  Finite  wordlength  robustness. 

DC  servo  motor.  State  variables  in  sens or  coordi¬ 
nates  are  x*(at  ui  i]  1  with  am  shaft  angle,  m* 
angular  velocity,  1* armature  current,  input:  volt- 
voltage  u.  Assumptions:  a)  load  torque  * cu , 

b)  all  state  variables  normalized  to  their  maximal 
values,  c)  simple  numerical  values 
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(39) 
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d)  state  feedback  u"  k^r-Xj^-kjXj-kjXj, 
which  gives  a  zero  stationary  error  llmCr-x^ft)] 
for  a  step  reference  input  r,  provided  the  system 
is  stable.  Find  k’*(k^  k3  k3I  such  that 
i)  stability  is  F23  robust  for  all  loads  c. 

11)  For  a  load  c*2  a  complex  pair  of  eigenvalues 


with  damping  l A/?  or  more  is  required: 
Boundaries  A  and  B  in  the  s -plane  of  Fig.  3. 
This  specification  shall  be  F2,  F3,  and  P23 
robust . 

Hi)  A  tradeoff  with  the  magnitude  of  u*max|u|  and 
the  maximum  bandwidth  is  to  be  made. 

The  observability  analysis  shows,  that  a  cannot  be 
observed  by  ui  or  1,  thus  the  a  sensor  is  essential, 
i.e.  the  reliability  with  respect  to  a  failure  of 
the  1  sensor  can  be  increased  only  by  redundant  or 
sensors.  The  gain  ki  will  be  determined  first.  F23' 
robustness  of  stability  requires  that  P(s)  • 
s2+(1+c)s2+(Hc)s-Hc3,  c>0,  is  Hurwltz,  i.e. 

0<k3<  (1+c)2.  The  worst  case  is  c-0.  For  maxi¬ 
mum  bandwidth  choose  k,*l. 
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i.e.  ^-Pg-l,  k2*p1-cp,-l+c2,  kj^-i-c.  By  eq. 

(25  )  P  (s )“  (s2  -2osdo2du)2  )  (q+»)*q  (o2h«2  )+(o24u)2-2oq)  s 
+(q-2o)s2rs3.  p(J*q(a2hi)Z)“l  guarantees  q>0,  i.e. 
the  real  eigenvalue  is  stable.  For  c*2  and  boundary 
A,  i.e.  U)2*o2,  p0*2qo2,  P3*2c(a-q),  p2"q-2a  and  by 
eq.  (41)  kj»2qCT2*l,  k2»2a(a+2)-2q(l*J)+3,  k3*q-2a-3. 
By  k,*p *1,  q"l/2a2,  the  product  of  eigenvalues  is 
fixed  and  k2*2a  (a+2  )  -  (Ho  )  /o2+3 ,  kj-l/2a2-2a-3. 

This  is  curve  A  in  Fig.  S.  A  Bode  plot  shows 


Fig.  5.  Tradeoffs  between  tachometer  (kj)  and 

amperemeters  (k3)  feedback  for  a  dc  motor. 

that  the  maximum  bandwidth  is  obtained  if  real  and 
complex  poles  have  the  same  distance  from  the 
origin,  i.e.  q*l,  o*-lA/2,  see  Fig.  S.  The  minimum 
iT  is  obtained  at  the  point  of  curve  A,  which  is 
closest  to  the  origin. 

For  boundary  B  P(s)“(s-a)2(s+q)“qo2-fe(o-2q)s+ 
(q-2o)s2-fs3,  and  as  before  k2*5(o"*4)-2(l-tcr)/<j2+3, 
k3*l/o2-2o-3.  Points  in  the  shaded  region 
satisfy  specifications  il).  The  point  of  maxlesim 
bandwidth  on  tha  A  curve  is  not  in  the  robust 
region,  therefore  damping  >  1A/7  is  necessary.  If 
q*l  is  kept  constant  and  the  complex  poles  move 
along  the  unit  circle,  then  k  moves  elong  a 
straight  line  in  the  k2-k3-plene.  TWo  points  of 
this  line  are  k?*k3*0  for  a  triple  pole  at  s*-l  and 
the  point  o*-l/v?  on  curve  A.  Thus  a  good  first 
choice  would  be  the  point  k2*0.3,  k3*-0.3  indicated 
by  the  triangle  in  Fig.  S. 


Crane-  Consider  a  crane  wieh  Che  physical  para¬ 
meters  r^-crab  mass,  mL-load  mass,  1  “rope  length. 
Its  state  variables  are  x3«crab  position,  x2acrab 
velocity,  Xj“rope  angle  and  x^«rope  angular 
velocity.  For  small  rope  angles  the  linearized 
state  equations  are 
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(42) 


vith  o2"(n^+m^)g/ti \.X.  Let  g“10m/sec2  for  opera¬ 
tion  on  earth.  Input  u  is  the  force  accelerating 
the  crab.  Eigenvalues  are  [ 0,0, Jui,-Jir]  .  The 
observability  analysis  shows  that  x^  is  not  obser¬ 
vable  by  x2,  x3  or  Xa>  ttlus  the  crab  position 
sensor  is  essential.  It  was  shown  in  [5]  that  X2 
must  be  measured  or  estimated,  without  x2-feedback 
a  stabilization  is  Impossible. 


Given:  m,.*1000kg,  X"10m,  maximum  load  3000kg, 
design  a  sampled-data  controller 


u(kT)  » -k'x(kT)  (43) 

for  the  following  specifications : 

i)  Consider  a  typical  movement:  Pick  up  a  load 
at  rest  and  drop  it  10m  away  at  rest  again, 
l.e.  Initial  state  x”l  10  0  0  0)',  final  state 
x*0.  During  this  movement  the  required  force 
should  not  exceed  3000  Newton. 

ii)  The  amplitude  of  the  load  oscillation  after 
10  seconds  should  ba  small  for  two  typical 
loads  m^  of  3000  kg  and  1000  kg. 

ill)  It  is  desirable  to  avoid  the  measurement  of 
the  rope  angular  velocity  x^. 

The  sampling  Interval  T  was  selected  such  that  in 
the  worst  case  m^a3000  kg  the  complex  poles  in  z- 
plane  lie  on  a  43°  angle  with  respect  to  the  post: 
five  real  axis.  This  results  in  T“n/8. 


The  discretization  and  evaluation  of  the  g.  matrix 
were  done  in  center  of  mass  coordinates,  in  which 
the  system  is  block  diagonalized.  The  result 

is  then 
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£  "  [  £3  aEj-tJj  J  •  "  "'i//  (m.+m^)  (44) 

(m  -ha. )  (2  sin  juT-  sin  2wT) 

E  »  -r-= - = - 

“1  Tz-  (5  sinujT-4  sin  2u:T+  sin  3u)T) 

-m cl 

-2*  2sinu)T/2  (5sinujT-4sin2u)T+sin3<jjT)1  ^-1-2-3 V  ’ 
cos  (i-l/2)iuT-2cos  (l-3/2)wT+cos  (i-5/2)uiT]"l 
-i  L  si(  sin (1-1/2 )uiT-2sln (1-3/2 )uiT+sin(i-5/2 )uiT)J 

i-0,1,2,3,4. 

Note  that  this  form  g”g(mti,mc  ,1  ,T)  could  also  be 
used  to  Implement  a  gain  scheduled  control  law 
k'”E.'£“k'  (m^.mg  ,1 ,T),  which  keeps  the  eigenvalues 
constant . 


In  the  first  design  step  a  first  guess  for  k '  is 
determined  for  mj^SOOOkg  only.  First  a  partial 
pole  placement  is  made  by  eq.  (14),  which  gives  a 
1/vT  damping  to  the  pendulum  motion  without 
changing  its  natural  frequency,  l.e.  a  pole  pair 
at  *1  2”°-4®7®±J°-3026.  For  the  Initial  condition 
x(0)“l  10  0  0  0)'  the  first  control  input  is 

u(0)“10k,,  thus  k^ ^ 500 (Newton /m)  is  necessary  to 
meet  specification  i).  For  a  fast  response  k]^“500 
is  chosen.  After  specifying  two  eigenvalues  and 
one  feedback  gain  there  remains  one  free  parameter, 
which  is  conveniently  exhibited  as  a  parameter  on 
the  root  locus  for  the  remaining  two  poles.  Its 
complex  part  is  a  circle  around  z*l  with  radius 
0.1786,  che  intersection  of  this  circle  with  the 
l/V?  damping  spiral  at  z3  a-0.8657+)0. 1177  is 
chosen.  This  results  inkWsOO  1927  7867  -788). 


The  simulation  shows  that  u(kT)  does  not  exceed 
5000  Newton.  For  the  nominal  load  of  3000kg  the 
maximal  amplitude  after  10  seconds  is  4.33  of  Che 
initial  displacement.  This  first  solution  is  how¬ 
ever  unsatisfactory  for  m,«1000kg,  with  a  maximal 
amplitude  of  12.37.  after  10  seconds. 

In  che  second  design  step  primarily  the  solution 
for  raj^lOOOkg  must  be  speeded  up.  From  the  first 
solution  only  the  values  k1"500  and  kj“1927  are 
kept  and  k-j  and  k,,  are  the  free  parameters  of  the 
second  step.  The  four  eigenvalues  move  with  kj  and 
k^,  they  shall  be  kept  however  in  the  circle  r“0.5 
in  Fig.  2.  The  circle  maps  into  the  3000kg 
boundary  in  the  kj-k^  plane  shown  in  Fig.  6. 


Fig.  6.  A  crane:  Robustness  with  respect  to  large 
load  variations . 

At  point  A  there  are  two  different  complex  con¬ 
jugate  eigenvalue  pairs  crossing  the  circle  simul¬ 
taneously,  such  that  the  complex  root  boundary 
Intersects  Itself.  The  right  real  boundary  is  out¬ 
side  che  figure.  At  point  B  the  complex  and  the 
left  real  root  boundary  for  Zj“-0.05  meet,  l.e. 
this  k3.lv,  pair  generates  a  double  pole  at  z“-0.05. 
In  points  C  and  D  a  complex  pair  and  a  real  root  at 
z“-0.05  cross  the  boundary  simultaneously.  The 
1000kg  boundary  has  a  similar  shape,  only  its 
right  part  and  the  intersection  D',  corresponding 
to  D,  are  shown.  Thus  the  first  design  point  indi¬ 
cated  by  the  triangle  must  be  moved  to  the  left; 
let  k3«4000.  Since  k^  is  ssmll  anyway,  k4*0  is 
chosen  in  view  of  specification  ill).  Simulation 
shows  chat  the  maximum  amplitudes  after  10  seconds 
are  6 .47.  for  3000  kg  and  37.  for  1000  kg  .  The  angle 
x3  remains  small,  such  Chat  this  assumption  for  Che 
linearization  of  the  plant  equation  is  satisfied. 

If  necessary  a  third  design  stap  could  follow  in 
which  kj*500  and  k4*0  are  fixed  and  kj  and  kj  are 
varied. 

5.  CONCLUSIONS 

Classical  parameter  plane  ideas  have  been  combined 
with  pole  placement  results  to  a  design  method  in 
X  space.  The  crucial  step  le  the  introduction  of  a 
plant  representation  in  the  form  of  the  matrix  £  in 
eqs.  (16)  and  (A.S).  The  linear  mapping  from  ff 
space  to  X  space  is  performed  by  a  multiplication 
with  the  matrix  E  and  is  thus  reduced  to  a  computa¬ 
tionally  very  simple  step.  In  X  space  typical 
design  aspects  such  as  actuator  limitations  and 
robustness  with  respect  to  sensor  and  actuator 
failures,  large  parameter  variations  and  short 
wordlength  Implementation  have  elementary  geometric 
interpretations,  and  several  questions  of  practical 
Interest  can  be  treated  in  a  clear  and  simple  way 


as  is  Illustrated  by  three  examples. 

The  examples  are  restricted  so  far  to  tradeoffs  in 
two  free  parameters  at  a  time,  where  a  graphical 
Interpretation  In  cross-sections  of  the  *(  space  is 
possible.  This  Is  already  a  practically  applic¬ 
able  cool  with  apparent  advantages  over  graphical 
one-parameter  methods  like  root  locus.  For  example 
in  successively  closing  loops  of  a  cascaded  system 
it  allows  to  make  tradeoffs  between  two  successive 
steps . 

The  concept  of  the  method  is  however  not  limited 
in  the  number  of  parameters.  Due  to  the  computa¬ 
tional  simplicity  of  the  mapping  it  seems  feasible 
to  develop  computer-aided  design  methods  with 
displays  visualizing  three-dimensional  surfaces 
and  regions  by  moving  point  of  view  or  moving 
cross-section.  If  the  computer  has  Co  make  Che 
tradeoffs  in  problems  with  many  parameters,  diffi¬ 
culties  arise,  if  there  does  not  exist  a  point  in 
X  space  satisfying  all  specifications.  In  this 
situation  Che  concept  of  a  moving  boundary  may  be 
useful,  which  was  used  by  Zakian  and  Al-Naib  [6] 
in  the  numerical  treatment  of  inequalities.  In 
Figs .  1  and  2  this  means  that  the  parameter  P  or  r 
is  varied  continuously  until  a  solution  is  found. 
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The  generalization  of  eq.  (16),  k'*E.'E,  to  the 
multivariable  case  was  published  in  [5]  and  is 
quoted  here  for  easier  reference: 

Given  a  controllable  pair  (A,B) ,  let  B“(bj  ...bp) 

rlk»rank[B,4B  .  .  Ak  ...A^b.)  i»l,2...p 

r  \r  (A.1) 

ok  rpk-l 

A  controllability  index  i“l,2..p  of  the  pair 
(A,B)  is  the  smallest  integer  k  such  chat  rik* 

ri-lk'  ^hen  &  -i  is  linearly  dependent  on  the 
vectors  left  of  it  in  the  controllability  matrix 
and  can  be  expressed  as 

/i.  -  , _  .ui*l.,_  /l,  . . 


4  b.i"-(  B  A  B. .  .A  1  B]ot-{A  ^...A  b^]^.  (A.2) 

In  order  to  make  Bn- •  -8ii-ll  '  unique,  let 
9^*0  if  u,  £4^.  Let 


Note  chat  by  Popov's  theorem  on  feedback  invariants 
( 71  ,  ls  invariant  under  a  transformation 
(A,B)  -  (T(A-B^)T*1TB)i  detTl^O.  Let 

ra, 

4t-l  4-1  . 

R-[br..A  b^ . A  P  b  ],  R  -  :  (A.4) 


and  the  last  row  of  the  4^xn  matrix  (Jj.  Let 
E  “  [ r1  ]  £.*[— i  —  (A 


Introduce  nxp  characteristic  parameters  in  a  pxp 
matrix 


[Epi  •  •  •  EppJ 

with  Pu-IPli0  Piu  •••  Pj.^-1 


Pij  "  lpij0  Pijl  ’  Pij4j 


-l  01  il*j 


P'  generalizes  js’,  the  vector  of  coefficients  of  the 
characteristic  polynomial,  its  coefficients  p... 
are  the  coordinates  of  an  nxp  dimensional  para*K 
meter  apace  9-  P*  is  related  to  the  characteristic 
polynomial  by 

PO  )  -detdl-A+BK'l-dettP'-diag^)! , 

^-(1  X  ...  X"1!  '  (A. 7) 

and  to  the  state  feedback  matrix  by 


K’  (A. 8) 

Thus  the  system  representation  (E.M^g)  may  be 
considered  as  a  mapping  between  two  nxp  dimen¬ 
sional  parameter  spaces  9  and  X •  Note  that  the  n 
coefficients  of  any  row  of  P1  enter  linearly  into 
the  determinant  in  eq.  (A. 7),  thus  they  can  be 
expressed  by  the  coefficients  of  P(X)  and  by  the 
remaining  nx(p-l)  characteristic  parameters  in  P' , 
which  parameterize  the  remaining  degrees  of  free¬ 
dom  after  pole  placement.  If  the  coefficients  of 
the  first  row  of  P1  are  eliminated  in  this  way, 
eq.  (A. 8)  results  in  n>p  equations  relating  the 
feedback  gains  to  the  n(p-l)  free  parameters. 

Due  to  the  structure  of  M^g,  n(p-l)  of  these 
equations  are  linear,  only  Che  equations  for  the 
elements  of  the  first  row  of  K  are  nonlinear  in 
the  free  parameters. 

The  free  parameters  can  now  be  chosen  according  to 
additional  requirements,  e.g.  minimizing  the 
maximal  feedback  gain  in  view  of  actuator  limita¬ 
tions  or  to  make  certain  columns  of  K'  equal  to 
zero  in  order  to  save  sensors. 
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Closed-Loop  Structural  Stability  for 
Linear-Quadratic  Optimal  Systems 

POH  KAM  WONG  and  MICHAEL  ATHANS.  fellow.  IEEE 

Abstract — This  paper  contains  an  explicit  parametrization  of  a  subclass 
of  linear  constant  gain  feedback  maps  that  will  not  destabilize  an  originally 
open-loop  stable  system.  These  results  can  then  be  used  to  obtain  several 
new  structural  stability  results  for  multiinput  linear-quadratic  feedback 
optimal  designs. 


I.  Introduction  and  Motivaiion 

This  paper  presents  preliminary  results  which,  in  our  opinion,  repre¬ 
sent  a  firsl  necessary  step  in  the  systematic  computer  aided  design  of 
reliable  control  systems  for  multivariable  control  systems.  A  specific 
motivating  example  arises  in  the  context  of  future  high  performance 
aircraft.  It  is  widely  recognized  that  advances  in  active  control  aircraft 
and  control  configured  vehicles  will  require  the  automatic  control  of 
several  actuators  so  as  to  be  able  to  fly  future  aircraft  characterized  by 
reduced  stability  margins  and  additional  flexure  modes. 

As  a  starling  point  for  our  motivation  we  must  postulate  that  the 
design  of  future  stability  augmentation  systems  will  have  to  be  a  multi- 
variable  design  problem.  As  such,  traditional  single  input-single  output 
system  design  tools  based  on  classical  control  theory  cannot  be  effec¬ 
tively  used,  especially  in  a  computer  aided  design  context.  Since  modern 
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control  theory  provides  a  conceptual  theoretical  and  algorithmic  tool  for 
design,  especially  in  the  linear-quadratic-Gaussian  (LQG)  context  (see 
Athans  (I)  for  example),  it  deserves  a  special  look  as  a  starting  point  in 
the  investigation. 

In  spite  of  the  tremendous  explosion  of  reported  results  in  LQG 
multivariable  design,  the  robustness  properties  have  been  neglected. 
Experience  has  shown  that  LQG  designs  “work”  very  well  if  the 
mathematical  models  upon  which  the  design  is  based  are  somewhat 
accurate.  There  are  several  sensitivity  studies  involving  "small  parameter 
perturbations”  associated  with  the  LQG  problem.  We  submit,  however, 
that  the  general  problem  of  sensitivity  and  even  stability  of  multivariable 
LQG  designs  under  large  parametric  and  structural  changes  is  an  open 
research  area 

It  is  useful  to  reflect  upon  the  basic  methodology  in  classical 
servomechanism  theory  which  dealt  with  such  large  parameter  changes. 
The  overall  sensitivity  and  stability  considerations  were  captured  in  the 
definition  of  gam  and  phase  margins.  If  a  closed-loop  system  was  char¬ 
acterized  by  reasonable  gain  and  phase  margins,  then  I)  reasonable 
changes  in  the  parameters  of  the  open-loop  transfer  functions  and  2) 
changes  in  the  loop  gains  due,  for  example,  to  saturation  and  other 
nonlineahties  could  be  accommodated  with  guaranteed  stability  and  at 
the  price  of  somewhat  degraded  performance. 

Although  LQG  designs  are  time-domain  oriented  nonetheless  their 
frequency-domain  interpretations  are  important,  although  not  univer¬ 
sally  appreciated.  For  example,  for  the  case  of  single  input-single  output 
linear-quadratic  (LQ)  optimal  designs  Anderson  and  Moore  [2)  have 
shown  that  LQ-optimal  designs  are  characterized  by 

1)  an  infinite  gain  margin  property  and 

2)  a  phase  margin  of  at  least  60  degrees. 

Such  results  are  valuable  because  it  can  be  readily  appreciated  that  at 
least  in  the  single  input-single  output  case,  modern  control  theory 
designs  tend  to  have  a  good  degree  of  robustness,  as  measured  by  the 
classical  criteria  of  gain  and  phase  margin. 

Advances  in  the  multiinpul-multioutput  case,  however,  have  been 
scattered  and  certainly  have  not  arrived  at  the  cookbook  design  stage 
Multivariable  system  design  is  extremely  complex.1  To  a  certain  extent 
the  numerical  solution  of  LQ-optimal  problems  is  very  easy,  however, 
fundamental  understanding  of  the  structural  interdependencies  and  its 
interactions  with  the  weighting  matrices  is  not  a  trivial  matter.  We 
believe  that  such  fundamental  understanding  is  crucial  for  robust  designs 
as  well  as  for  reliable  designs  that  involve  a  certain  degree  of  redundancy 
in  controls  and  sensors. 

The  recent  thesis  by  Wong  (3 (  represents  a  preliminary  yet  positive 
contribution  in  this  area.  In  fact  the  technical  portion  of  this  paper 
represents  a  slight  modification  of  some  of  the  results  reported  in  (3|.  In 
particular  we  focus  our  attention  on  the  stability  properties  of  closed- 
loop  systems  designed  on  the  basis  of  LQ-optimal  techniques  when  the 
system  matrices  and  loop  gains  undergo  large  variations. 

The  main  contributions  reported  in  this  paper  are  the  eventual  results 
of  generalizing  the  concepts  of  gain  margin  and  of  performing  large-per¬ 
turbation  sensitivity  analysis  for  multivariable  linear  systems  designed 
via  the  LQ  approach.  (For  a  corresponding  generalization  of  the  phase 
gain  margin  results  to  the  multivariable  problem  see  the  paper  by 
Safonov  and  Athans  (7).) 

We  warn  the  reader  that  much  additional  theoretical  and  applied 
research  is  needed  before  the  implications  of  these  theoretical  results  can 
I)  be  fully  understood  and  2)  translated  into  systematic  "cookbook" 
procedures  that  have  the  same  value  as  the  conventional  results  in 
classical  servomechanism  design. 

This  paper  is  organized  as  follows:  in  Section  II  we  present  an  explicit 
parimetnzation  of  a  subclass  of  linear  constant  feedback  maps  that 
never  destabilize  an  originally  open-loop  stable  system,  and  establish 
some  of  its  properties.  In  Section  III,  we  apply  this  construct  to  obtain 
several  new  closed-loop  structural  stability  characterizations  of  multun- 
put  LQ-optimal  feedback  maps.  We  conclude  in  Section  IV  with  a  brief 
discussion  of  the  relevance  of  the  results  of  this  paper  for  computer- 
aided  iterative  feedback  design. 

'Even  the  notion  of  what  ccnstiiuwt  a  "aero"  of  a  multivariable  transfer  mains  wat  not 
fully  appreciated  until  recently 


Notation 

1 )  The  linear  time-invariant  system 

x(t)-Ax(t)  +  Bait) 
i(t)-HTx(l) 

where 

xQlelfl”  x(  )  state  vector 
s(l)£fl"  «(■)  control  vector 
:  ( /  >  £  <’ttr  z(  )  output  vector 

and 

A  6  SR"X" 

B&W*m 

will  be  denoted  by  Z(A.B.HT).  Where  H  T  is  irrelevant  to  the  discus¬ 
sion,  we  will  shorten  the  notation  to  Z(A,  B)  and  where  the  choice  A , B  is 
clear  from  the  context,  we  will  just  use  X. 

If  the  matrix  A  is  stable  (i.e..  all  eigenvalues  of  A  have  strictly  negative 
real  parts),  we  will  refer  to  Z(A.B,HT)  as  a  stable  system. 

2)  Let 

R  ( K  )  range  space  of  A 
MIA)  nullsp ace  (kernel)  of  A 
RkiA)  rank  of  A  . 

3)  Given  the  system  Z(A.B.Hr), 

R(A.B)  —  controllable  subspace  of  the  pair  ( A  B ) 

-  R(B)  +  AR(B)+  -  +A’~'R(B) 

N (Ht,A)  =  unobservable  subspace  of  the  pair  ( HT.A ) 

-  n  y(HTA-1). 

i- 1 

4)  If  getH"*"  is  positive  semidefinite,  we  will  write 

Q>  0. 

If  Q  is  positive  definite,  we  will  write 

Q>  0. 

5)  Im^l  denotes  the  matrix  M  whose  (ij)  element  is  mv. 

II.  Parametri/aiion  of  Nondestabilizing  Feedback  Maes 

We  begin  our  discussion  with  Definition  I. 

Definition  I:  Given  the  stable  system  2(A,B),  let 

SiZ)  -  {  Gre<ir '"’|M  +  BGt)  is  stable }. 

i.e..  S(Z)  is  the  set  of  all  feedback  maps  that  will  not  destabilize  an 
originally  open-loop  stablt  system  where 

»(/) «  6rx(»). 

Ideally,  one  would  like  to  be  able  to  explicitly  parametrize  S(X).  but 
as  this  is  a  well-known  intractable  problem  our  strategy  here  is  to  look 
for  a  simple  paramctri/.ation  of  a  (hopefully)  suffiiiently  general  subset  of 
S(Z) 

We  begin  by  first  recalling  some  standard  Lyapunov-type  results. 
Ijemma  I  (Wonham) 

1 1  If  A  is  stable,  then  ihe  Lyapunov  equation 


RA  +  A  rP+  (?“• 


itct  hu^oaliiuns  UN  At,  I OMA 111' CONTROL,  FEBRUARY  IV// 


with  Qe •  has  a  unique  solution  P» 0.  II.  in  addition,  (QI/2,A )  is 
observable,  then  P>t. 

2)  If 

P  >*,  satisfy  PA  +  A  TP+  Q -  0 
(Q,/2.A)  is  detectable 

then  A  is  stable. 

3)  If  Q  >•  and  (Q,/2.A)  is  observable  (detectable),  then  for  all  p»0, 
K>0  and  for  all  B,FT.  the  pair  (Vq+P+FBFt  .  PA  +  BFT)  is 
observable  (detectable). 

Proof:  For  I),  see  [4,  p.  298).  For  2),  see  [4,  p.  299).  Fjr  3).  see  |4,  p. 

82). 

To  proceed,  the  following  definition  will  be  useful: 

Definition  2:  For  any  stable  A,  let 

LP(A)  -  (A>9\AA+ATA<.0) 

LP*(A)-  {lf>#|JC4+i4rfr<0). 

Remark:  LP(A )  is,  in  general,  a  proper  subset  of  the  set  of  all 
positive-semidefinitc  matrices  of  dimension  n. 

Example:  Suppose  that 


A  - 


A,  0 


A,  <0,  Aj<0. 


Then 


LP(A)- 


*i 


*l>0 


,K,K}> 


K  j>0 


(A,  +  a2 


4A.A, 


Note  that 


>0  iff  AT,  >0,  A’2>0, 


A,A2>  A,2,  and 


Definition  3:  Given  the  stable  system  H.A.B),  let 

S,(2)- (c^ea-x-ic^-fs-t)*^,  S--Sr,  t>*. 

and  either  KeLP*(A )  or  else  KeLP(A)  with  R(S)C  R(L))- 
We  can  now  state  our  result  as  Theorem  I.- 

Theorem  I:  Given  the  stable  system  HA, B),  then  1)  GreS,(2) 
implies  ( A  +  BC r)  is  stable  and  2)  f  “eAT'QeA'  dt  > 

)  oeiA*9cT)T'QeIA*,cTi,dt  where  Q>  t  is  such  thgt  KA  +  ArK  +  Q-» 
and  Gt  -  (S-  L)BrA  eS,(2). 

Proof: 

1 1  Let  M ■  BLB r.  A'-  BSB T  in  Lemma  3,  and  the  result  follows 
directly. 

2)  Let  Q  >  0  be  such  that 


AA+ArA  +  Q-».  (I) 


Then  we  have 


that 


K,  K„ 

(A|  +  A2)j/4A,A2>  1,  with  equality  iff  A,»A2. 

Lemma  2: 

1)  LP(A)  is  a  convex  cone,  i.e.,  Kl,K1e  LP(A)  implies  «,jr,  +o2A2e 
LP(A)  for  all  a,  >0,  a2>0; 

2)  If  €Lf>(^,)nLf,M2)  implies  K&LPIA^Aj), 

3)  A£LP(A)  implies  K E LP(A  +  B(S- L)BTA): 

for  all  S,L  such  that  S-  - ST,  L> 0,  provided  (A  +  B(S~  L)BrA)  is 
stable. 

Proof:  Straightforward. 

We  are  now  ready  to  introduce  our  first  crucial  result. 

Lemma  3;  Let  A  be  stable.  Then  (A  +  (/V- M)A)  is  stable  for  all 
KeLP(A)  and  for  all  M> 0,  /V--Nr  such  that  R(N)cR(M).  If 
K  e  LP*(A),  then  the  condition  R(N)z  R(M)  can  be  omitted. 

Proof:  Let  Q  —  -  (KA  +  ATK).  Since  K  6  LP(A).  we  have  QpO, 
and  A  stable  implies  (Q,/2.A)  is  always  detectable. 

Now  AA+ArA  +  Q-k,  so  A  (A  +(N- M)K)  +  (A  +((V-  M)K)rK  + 
2KMK+Q-(KNK+KNTK)-9b\n  ANA  A-  ANrA-0  since  N-  -  NT. 

If  KeLP*(A),  then  (?>•  so  (\/Q+2AMA  ,(A  *(N- M)A))  is 
observable,  which  implies  (A  +(JV- M)A)  is  stable  by  Lemmas  1-2. 

Otherwise,  assume  R(N)c  R(M)  which  implies  that  there  exists  V 
such  that  /V-  VM  or  that  (IV-  M)JT-(  V—  DMA 
By  defining 

B~(y-I)M'/2 

Ft~M'/2A 

P-0 

B-l 

in  Lemmas  1-3,  we  have  that  (VQ  +  2AMA  .A  +  (/V-  M)A)  is  detect¬ 
able.  By  Lemmas  1-2,  we  therefore  have  (A  +  (N- M)A)  stable.  Q.E.D. 

Remark:  A  special  case  of  Lemma  3  was  established  by  Barnett  and 
Storey  in  |S|. 

By  specializing  Lemma  3,  we  immediately  obtain  an  explicit  parame- 
Irizalion  of  a  subclass  of  stabilizing  feedback  First  we  introduce  Defini¬ 
tion  3. 


A-  f  XeAT,QeA,dt . 

JO 

Ncxi  rewrite  (1)  as 

A(A  +  BCr)  +  (^*+  BGT  )TK  +  (2ABLBTA+  Q)-0 
where  G T  -  (5-  L)BTA €  S,(£)  which  implies 

A  -/  “>*♦  >'  (2  ABLB  rA  +  Q  )eiA  r  >'  dt ; 

•'o 

hence 

[^e^'Qe^dt-  ["‘ft****7  iT'Qe(A  *t°T)'dt 
Jo  JO 

+  2  (  "el*  ♦  *T  )T  KBLB  TKe{A  4  *T  "di 
Jo 

or 

(°°eAT'QeA'<tt>  f  QED 

r 0  Jq 

Remark:  It  can  be  easily  shown  that  all  the  eigenvalues  of  the  feed¬ 
back  term  B(S -  L)BTA  have  nonpositive  real  parts.  This  observation, 
and  the  content  of  Theorem  1-2),  makes  it  convenient  to  interpret  S,(2) 
as  a  natural  generalization  of  the  concept  of  “negative"  feedback  to  the 
multivariable  and  multiinput  case. 

The  next  two  corollaries  are  easy  consequences  of  Theorem  I . 
Corollary  l.l:  Let  2(A.B)  be  a  system  with  a  single  input,  i.e.,  let  B 
be  a  column  (nx  I)  vector  h.  If  gf,  •  .g/e  S,(2(A,*)),  then 

J 

2  o,g(re  Sf  (2),  for  all  a,  >  0,  i-  I,-  ■  •  J. 

i- 1 

Proof:  Each  g;r  is  of  the  form  ~rlkTA,  lor  some  admissible  rt  >0. 
*,  a 0  so  2'. ,  -  a,r,k - k r(2'. ,a,r,A,). 

But  from  Lemma  2-1)  A,eLP(A)  implies  2>_,a1rlKieL/,M)  for  all 
a,r,  a  0:  hence.  S<.,a,g,r£  LP(A)  for  all  o,  >0.  Q.E.D. 

Corollary  1.2  Suppose  there  exists  L  >0  such  that  BLBT e  LP(A  r). 
Then  (A  -  BLBT(A  +  N))  is  stable  for  all  A  >0  and  N-  t  NT  such  that 
R(A)D  K(/V). 

It  BLBreLP*(AT)  actually,  then  the  condition  R(A)d R(W)  can 
be  omitted. 

Proof:  Immediate  from  “taking  the  transpose"  in  Lemma  3.  Q.E.D. 
Theorem  I  has  illustrated  the  importance  of  LP(A).  It  is  therefore 
useful  to  have  an  alternative  characterization  of  LP(A). 

Proposition  I:  LP(A )  is  A  r-invanant,  i.e.,  for  all  A  e  LP(A). 
\AtR(A)cR(  *).) 

Proof:  A  6  LP(A)  iff  AA  +  A  rA+  HHT -•  for  some  H  We  claim 
that  N{A)- N [Ht. A)- unobservable  subspace  of  ' ,,r  A),  for  A- 
f  g‘eAT'HHTeA'dt  so  MeN{HT.A)  implies  HTeArt- u  tor  all  ten 
which  implies  *e  N{A).  Conversely.  eS  N(A)  implies  xrAt  «0  which 
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implies  / J’|#7if4,x|J<*-0  or  HTeA'x“ 0  lor  all  ( 6ft,  i.e.,  are 
N(Ht,A). 

To  complete  the  proof,  note  that 

R(K)-R(Kr)-N(K)1 

-NfH^A^ 

- R(At,H ) 

-  controllable  subspace  of  (A  T,  H ). 

But  any  controllable  subspace  of  A  T  ts  necessarily  an  A  ^-invariant 
subspace.  Q.E.D. 

Remark:  The  significance  of  Proposition  1  is  that  it  provides  a  sys¬ 
tematic  means  for  generating  members  of  LP(A).  For  example,  if  A  has 
distinct,  real  eigenvalues,  then  every  K  6  LP(A)  is  of  the  form 

fi-PTMP 

where  the  rows  of  P  are  left  eigenvectors  of  A,  i.e., 

PA  -A P,  A -diagonal  (A,,  •  •  ,A,) 

and  M  >%  is  such  that  ( -  (A,  +  Ay)m,-]  >  0,  where  M  «[mj. 

Thus,  all  members  of  LP(A)  can  be  generated  once  P  is  known. 
While  membership  in  S,(2)  is  sufficient  to  guarantee  closed-loop 
stability,  it  is  of  course  not  necessary,  i.e.,  S,(I)  is  a  strictly  proper  subset 
of  S(2).  Intuitively,  if  the  open-loop  system  is  stable  “enough”  to  begin 
with,  it  can  tolerate  a  certain  amount  of  “positive"  feedback  without 
leading  to  closed-loop  instability.  In  other  words,  the  poles  of  the 
open-loop  system  can  be  shifted  to  the  right  by  feedback  without 
destroying  stability  so  long  as  none  of  them  get  shifted  into  the  closed 
right-half  plane.  By  allowing  such  additional  nondestabilizing  feedback, 
therefore,  we  ought  to  be  able  to  “enlarge”  S,(2).  More  precisely,  we 
have  Definition  4. 

Definition  4:  Given  the  stable  system  2{A,B)  and  any  i.  >  O  f.  6 
91"*",  let 

LP(X,L)  —  (K  >B\KA  +ATK  4  2KBLB TJf  < 0 ) 

LP*  (2,i)  -  { K>9\KA  +  A  rK +  2KBLBrK  <0) . 

Definition  5:  Given  the  stable  system  2M ,  il ),  let 
SjOE)-  {Gre9l**"|Gr 

and  either 

KGLP+a.L) 

or  else 


F,(B)-  \GtE^-\RKIGtB)<RK(Gt)). 
Proposition  2 


F,(B)r\F2(B)^<, 

/•|(«)UF2(*)-91"*", 

i.e.,  any  feedback  map  Gr€9 1"*"  is  either  in  the  set  F,(B)  or  else 
F2<S). 

Proof:  We  need  only  to  show  that 

F,(f»)=>  {  GTe‘%"'*"\RK(GTB)-RK(Gr)). 

Necessity  Suppose  GT £  F,(B),  i.e.,  there  exists  De9 1“*“  and 
*£<*"*",  K  >0  such  that  GT=DBTK.  Then 

G  rBD  T  —  DB  tKBD  7  >  0 

so  RK(G7B)>  RKiG7BDT)  =  RK(DBtKBDt)=  RK(DBtK )  = 
RK{Gr) 

Sufficiency:  Take  D  =  G’B  and  observe  that  tne  equation 

gt-gtbbtk 

has  a  solution  K  0  if  RKiG7B)  =  RK(GT).  Q.E.D. 

We  now  relate  the  content  of  Proposition  2  to  Theorem  2.  Observe 
first  that  S,(2)C  fj(ft ),  and  hence  our  parametrization  scheme  fails  to 
capture  any  nondestabilizing  feedback  map  tF2(B).  That  S(2D)n  F2(B)st 
0  is  demonstrated  by  the  following  trivial  example. 
trample: 


A,  0 
0  A2 


and  (A  4  bg7 )  = 


f  I 

(I 

1 

*2 
if  B 


A,,A2<0 
.  *r-lo  ilef2(») 


is  stable. 

is  of  full  rank,  then  the  set  FfB)  is  NOT 


Note,  however,  that 
generic  in  91"*". 

The  more  interesting  question:  is  S2(£)  generic  (i.e.,  dense)  in  S(2)n 
Fj(A)?  is  at  present  unsolved. 

Our  results  so  far  have  been  on  systems  which  are  open-loop 

stable;  the  question  next  arises  as  to  what  the  situation  would  be  for 
systems  which  are  NOT  open-loop  stable  (i.e.,  A  has  unstable  poles).  For 
A  unstable  it  is  of  course  not  possible  to  write  down  Lyapunov-type 
equations.  One  is  reminded,  however,  of  the  algebraic  Riccati  equations; 
indeed,  we  have  the  following  interpretation  of  the  traditional  LQ-opli- 
mization  problem 

Definition  fi  Given  4/4.0)  a  slahilizable  pair,  let 


KeLPIXX) 

with 

R{L  +  S)cRU-L)} 

Theorem  2:  Given  the  stable  system  2( A,B),  then  Gr6  S2(2)  implies 
(A  +  BGT)  is  ruble. 

Proof:  The  proof  follows  by  a  straightforward  extension  of  the 
proof  of  Lemma  3  and  Theorem  I,  and  hence  is  omitted.  Q.E.D 

Remark  It  can  be  easily  seen  that  Theorem  I  is  just  a  special  case  of 
Theorem  2  (with  L  =•  and  L  <•,  ,V2(S)  will  be  reduced  to  5,(£)|  Note 
that  in  the  general  case  covered  by  Theorem  2.  no  defin-teness  assump¬ 
tion  is  made  of  L,  and  thus  various  “mixtures"  of  "positive"  and 
“negative"  feedbacks  are  allowed. 

The  next  proposition  provides  further  clarification  on  our  parametriza- 
non  scheme.  First  define 

F,(»)-  {Gre9l”**|Gr 

_  r»  •*  TV  w\  e-rnrmMm  %r  ppm*  *  • 


LQfA.B)  —  {  A  /0  A  =  KIA  B.R  HT  I  for  some  R  >0  and  some  HT 

such  that  IHT.A)  is  a  detectable  pair} 

where  KfA.B.R.H7 )  denotes  the  unique  positive  semidefinite  solution 
U>  the  algebraic  Riccad  equation 

KA  +  A  TK  -  KBR  'BrK  +  HHT-h 

For  R  fixed,  we  will  denote  the  corresponding  set  as  LQ(A.B.R) 
Definition  2 

S,<2)-  (  G7  e'sr*"|Gr-  -  R-'BTK.R>B,  K  eLQIA.  »;»))* 

Proposition  I  (men  any  stahili/able  system  2(A.B).  GrES jtiit  im¬ 
plies  ( A  4  BGrl  is  stable 

Remark  (he  above  proposition  merely  summarizes  the  well-known 
“standard"  results  of  IQ-optimal  feedback  theory  (see.  |l|  and  |4|) 
However,  the  interpretation  here  of  the  LQ-oplimal  feedback  class 
(S,(i:))  as  a  parametnration  of  a  subclass  of  stahilinng  feedback  is 
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III.  Structural  Stability  Charai tlxi/ation  of  Lima* 
Quadratic  (LQ>  Optimal  Flldbai  k  Maps 

In  this  section  we  show  how  the  parametrizauon  scheme  developed  in 
the  previous  section  can  be  applied  to  obtain  characterization  of  closed- 
loop  structural  stability  properties  of  systems  under  l.Q-opumal  feed¬ 
back.  More  precisely,  we  establish  an  explicit  parametrizauon  of  a 
general  class  of  structural  perturbations  in  the  control  iccdback  gains  as 
well  as  in  the  control  actuation  matrix  ( B )  that  leave  the  closed-loop 
system  stabilized.  These  new  results,  we  believe,  are  the  natural  generali¬ 
zations  and  nontrivial  extensions  of  some  earlier  results  of  Anderson  and 
Moore  (2|. 

We  begin  by  first  recalling  from  Lemma  2-3)  that  for  A  stable. 
KeLP(A)  always  implies  K£LP(A-  BLBrK).  however,  for  A  unsta¬ 
ble  and  If  >0  such  that  ( A  -  BLBrK )  is  stable,  it  need  NOT  he  true  that 
K  e  LP(A-  BLBtK).  The  following  example  underscores  this  unfor¬ 
tunate  stale  of  affairs. 

Example: 


Then 

(*-«•’*).[-!  _{] 

is  stable,  but 

K(A-BLBTK)  +  (A-BLBrK)TK-[  ~ j  ^]<°. 

However,  we  have  an  interesting  observation  in  lemma  4. 

Lemma  4  If  If  €  LQ(A.B.R),  then  K  e  LP(A  -  BR  1 B’K ). 

Proof  Immediate  from  the  Riccati  equation.  Q.E.D. 

In  other  words,  the  above  unfortunate  slate  of  affairs  cannot  occur  if 
K  is  an  LQ-solution. 

We  are  now  ready  to  state  our  first  main  result  of  the  section. 

Theorem  3  (Infinite  Gain  Margin  Properly):  Let  K  6  I  QiA.B:  R ) 
Then  (A  ~[B(S+  L)Br+  B(M+  M)Bt\K)  is  stable  for  all  L>R 
M  >0,  S--5r.  R(S)cR(L- R~').  R(IV)cRiM).  B  is 

arbitrary. 

Proof:  We  have  K  E  LP(A  -  BK  ~  'BTK),  so  by  Lemma  3,  (A  - 
BB-'BtK  +  (V-  »')#)  is  stable  for  all  W  V--VT  such  that 
R(  F)C  ff  ( IF).  lake  W-  B(L- R-‘)Br  +  BMBr  and  F-«S»r+ 
BNB T  and  we  are  done.  Q.E.D. 

Remark:  For  B  =0.  Theorem  3  is  a  generalization  of  the  "infinite  gain 
margin”  property  of  LQ-optimal  feedback  for  single-input  systems  first 
noted  by  Anderson  and  Moore  |l],  who  showed  that  the  feedback  gam 
vector  fr«  -\/rbTK  can  be  multiplied  by  any  scalar  a  >  I  without 
destroying  stability;  the  proof  they  used  involves  classical  Nyquist  tech¬ 
niques.  Theorem  3  not  only  generalizes  this  property  to  multiinput 
systems,  but  allows  more  complicated  alterations  of  the  feedback  gam 
vectors;  moreover,  it  makes  the  proof  of  this  property  much  more 
transparent. 

Remark:  For  Ba-9,  Theorem  3  allows  for  changes  in  the  B  matrix 
itself  without  destroying  stability.  One  useful  interpretation  is  the  follow¬ 
ing. 

Suppose  that  the  optimal  feedback  gain  matrix  has  been  computed  for 
a  nominal  B q,  but  that  the  actual  value  of  B  during  system  operation  is 
changed  to  B  -  B0  +  B ,.  Then  the  feedback  term  becomes  (  BqR  'B„A  + 
B,B  ~  'BjK)  As  long  as  Bx »  +  M)R  for  some  N-  -  Nr  Ms#, 

Theorem  3  will  guarantee  us  that  the  system  will  remain  stable.  (For 
example,  Bt  —  a>0.)  More  complicated  cases  are  allowed. 

Remark  Alternatively,  the  case  B  <*•  can  be  interpreted  as  allowing 
for  the  possibility  of  adding  extra  controllers,  and  using  these  extra 
feedbacks  to  “fine-tune”  the  closed-loop  behavior  of  the  original  system. 
(A  more  systematic  exploitation  of  this  idea  will  he  dealt  with  in  a  future 
publication;  see  also  (3|.) 

Theorem  3  has  dealt  with  the  case  when  the  “negative”  feedback 
gains,  etc.,  arc  allowed  to  increase  in  magnitude;  the  converse  situation, 
when  the  “negative"  feedback  gains  are  reduced  in  magnitude  (or  when 


there  is  system  struclual  parameter  changes)  is  examined  in  the  next 
proposition. 

Theorem  4  ( Gain  Reduction  and  Robustness  Property):  Let  K  >  0  be  the 
Riccati  solution  to  the  LQ-probfem  (A.B.R.Q)  where  R  >9  and 
(Q,/2.A)  delectable.  Then 

1)  (A-  B(M+  N)BtK)  is  stable  for  all  M>#  such  that  M  >}*->, 
N  «  -  Nt\ 

2)  if  {QW2.A)  is  actually  observable,  then  (A  -B(M+  N)BrK+ 

K  '((>+  A/)>  is  stable  where  M,N  are  as  above,  and  Q- QT  is  such  that 
Q<  \Q,  Q)OR(Q)  and  N-  -  NT  is  such  that  R(jQ-  Q)d 

«</V). 

Proof:  I)  Let  lc  m  Z((A  -  BR  'BTK).B)-2.(At,B).  Then  we 
have  K  e  LP (Zf;  j#  ~  ')  from  the  Riccati  equation  and  so  by  Theorem 
2.  [A'+B(M- N)BrK)  is  stable  for  all  M<!*-',  /V«-/Vror(A- 

BiR-'-M  +  N)BTK )  is  stable.  Let  M  -  *  -  M  >  ” ',  and  the 

proof  is  complete. 

2)  Let  Ac  «  (A  -  B(M  +  N)BTK).  From  the  Riccati  equation  we  have 
KAr  +  AjK  +  KB(1M-  R  ~')BTK+  Q-Q. 

Since  (Ql/J.A)-observable  implies  K  >0.K~  1  exists,  so  we  have 

K  (A,  +  K 1  (  P  +  JV))  +  (Ar  +  K '  (Q+  N))rK 

+  If* (2M  -  *  -  1  )B  rK  +  ( Q  -  2Q  )  -  #. 

Hence,  subject  to  the  condition  R(*tQ~  Q)D  R(Q+ N) 

it  can  be  shown  that  (\/ (Q-2Q)+  KB(2M- R  )BTK  ,AC  + 
K  '(Q+N))  is  observable.  Thus,  by  Lemma  1-3),  (Ac  +  K  ~ \Q+  iV ))  is 
stable.  Q.E.D. 

Remark:  Theorem  4-1)  is  a  generalization  of  the  known  “ gain  reduc¬ 
tion  tolerance"  property  of  LQ-optimal  feedback.  This  interpretation  it 
most  transparent  in  the  special  case  when  B  "'-diagfa,,- •  •  ,am)  and 
M-diag(ri|.  -  ,am).  N  =0.  Then  the  original  individual  feedback  loops 
are  of  the  form 

-  a,b,rlf,  i“  I, •••,!«. 

The  theorem  states  that,  in  this  special  case,  the  system  remains  stable 
if  the  feedback  gains  are  reduced  to 

at,  “  -  a:bfk 

so  long  as  a,  >  J</,. 

More  complicated  cases  are  of  course  allowed. 

Remark:  By  interpreting  the  additional  term  K  ~ \Q+  N)  as  a  model 
perturbation  term  4 A  of  the  open-loop  matrix  A,  we  can  use  Theorem 
4-2)  to  perform  finite  perturbation  sensitivity  analysis. 

The  following  simple  example  illustrates  the  usefulness  of  this  ap¬ 
proach. 

Example:  Let 

-5}  **[!]■ 

If  we  take 

«-[!  }}  -i- 

then  we  obtain  the  algebraic  Riccati  solution  as 


>[  '  °1 

lo  'J 


and  the  feedback  gain  f* 


-  2|  I  I ).  For  any 

P\  Pu+y 
Pn~y  P: 


P\  Pa 

Pa  Pi 
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multiloop  feedback  design  technique  (the  "inverse  Nyquist  array" 
method)  which  he  motivated  also  as  an  attempt  to  overcome  some  of  the 
above-mentioned  drawbacks.  His  approach  is  in  contrast  with  ours, 
which  is  a  “time-domain”  approach.  It  will  be  interesting  to  investigate 
the  connection,  if  any.  between  the  two  approaches. 

is  stable  for  all  a  >  j.  Consider  the  following  special  cases:  References 
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stable  for  all  o>{  and  0„0j  such  that  I)  >3, <0.5,/92< 3  and  2)  (0.5  — 

Thus,  if  0,-0,  the  perturbed  system  is  stable  for  all  02<  I.  Other  more 
general  cases  are  of  course  allowed. 

The  above  example  thus  shows  that  the  combined  effect  of  feedback 
gain  reduction  and  perturbation  or  uncertainty  of  the  open-loop  system 
parameters  (poles  and  coupling  terms)  can  be  tolerated  by  a  linear 
quadratic  design  without  leading  to  closed-loop  instability.  This  robust¬ 
ness  property  of  the  LQ-feedback  design  deserves  more  attention. 

IV.  Concluding  Remarks 

Since  further  applications  of  the  parametnzation  results  established  in 
this  paper  to  reliable  stabilization  synthesis  and  decentralized  stabiliza¬ 
tion  coordination  will  be  made  in  a  future  publication,  we  will  reserve  a 
fuller  discussion  of  the  implications  of  our  approach  until  then.  At  this 
point,  however,  we  would  like  to  point  out  an  important  implication  for 
practical  design  that  is  immediate,  the  ability  to  perform  feedback 
“loop-shaping”  analysis. 

In  any  realistic  synthesis  problem  (keeping  a  system  stabilized,  localiz¬ 
ing  particular  disturbances,  etc.)  there  is  usually  a  large  number  of 
feasible  solutions.  While  the  use  of  cost-critenon  optimization  (c.g..  LQ) 
in  theory  allows  the  designer  to  pick  exactly  one  such  solution,  in 
practice,  the  difficulties  of  judging  or  fully  incorporating  the  relevant 
cost  considerations  and  their  tradeoffs  as  well  as  the  often  gross  model 
uncertainties  and  physical  variabilities  of  the  system  and  the  controllers, 
necessitate  further  sensitivity  analysis  or  trial-and-error  "hedging"  about 
the  nominal  solution.  It  is  therefore  very  important  in  the  computer- 
aided  design  context  that  the  “feasible  solution  space”  structure  be 
known  in  some  details  to  facilitate  and  guide  the  conduct  of  iterative 
search.  In  this  regard,  a  major  merit  of  a  “classical"  design  technique 
like  root-locus  is  that  it  provides  an  explicit  functional  dependence  of  the 
closed-loop  system  structures  (distribution  of  poles  and  zeros)  on  the 
control  structure  (feedback  gain).  However,  such  classical  approaches 
become  totally  intractable  when  there  is  a  multiple  number  of  con¬ 
trollers,  while  modem  "state-space”  linear  feedback  design  techniques 
like  “pole-placement"  algorithm  and  “dyadic-feedback"  design  suffer  the 
serious  drawback  of  providing  little  structural  information  about  the 
solutions  they  generate,  and  moreover,  such  techniques  are  guided  more 
by  mathematical  convenience  than  by  physical  interpretation. 

From  this  perspective,  the  paramelrization  results  established  earlier 
appear  to  be  promising  in  orovidmg  the  basis  for  a  new  iterative  design 
algorithm  that  will  overcome  the  last-mentioned  drawbacks 

^VPfa I  tiRSff  sno  D  Araohennl'  (61  *uniMttR>l  a  ( r»rs . .  -  —  - .  ■  4  -  . .  •« 


Gain  and  Phase  Margin  for 
Multiloop  LQG  Regulators 

MICHAEL  G.  SAFONOV,  student  member,  ieee,  and  MICHAEL  ATHANS,  fellow,  ieee 


Abstract — Mulriioop  llarer  *»a^atfc  state-feedback  (LQSF)  regulators 
■re  shown  to  bo  robaat  ■galoot  a  variety  of  largo  dyuaatieJ  linear  ttme-ia- 
« art  ant  and  memory  koa  nonlinear  time-varying  variations  In  open-loop 
dynamics.  The  result*  are  Interpreted  In  terms  of  the  classical  concepts  of 
gain  and  phase  margin,  dm  strengthening  the  link  between  classical  and 
modern  feedback  theory. 

I.  Introduction 

II ISTOR1CALLY,  feedback  has  been  used  in  control 
*  *  system  engineering  as  a  means  for  satisfying  design 
constraints  requiring 

1)  stabilization  of  insufficiently  stable  systems; 

2)  reduction  of  system  response  to  noise; 

3)  realization  of  a  specific  input/output  relation  (e  g., 
specified  poles  and  zeros); 

4)  improvement  of  a  system’s  robustness  against  varia¬ 
tions  in  its  open-loop  dynamics. 

Classical  feedback  synthesis  techniques  include  proce¬ 
dures  which  ensure  directly  that  each  of  these  design 
constraints  is  satisfied  {!].  [2j.  Unfortunately,  the  direct 
methods  of  classical  feedback  theory  become  overwhelm¬ 
ingly  complicated  for  all  but  the  simplest  feedback  config¬ 
urations.  In  particular,  the  classical  theory  cannot  cope 
simply  and  effectively  with  multiloop  feedback. 

Linear-quadratic-Gaussian  (LQG)  control  theory  has 
made  the  solution  of  many  multiloop  control  synthesis 
problems  relatively  simple.  The  LQG  technique  [3]  pro¬ 
vides  a  straightforward  means  for  synthesizing  stable  lin¬ 
ear  feedback  systems  which  are  insensitive  to  Gaussian 
white  noise.  Variations  of  the  LQG  technique  have  also 
been  devised  for  the  synthesis  of  feedback  systems  with 
specified  poles  [4,  pp.  77-87).  [5],  (6).  Thus,  the  LQG 
technique  is  a  valuable  design  aid  for  satisfying  the  first 
three  of  the  aforementioned  design  constraints. 

The  results  which  follow  show  how  the  multivariable 
LQG  design  can  satisfy  constraints  of  the  fourth  type,  i.e., 
constraints  requiring  a  system  to  be  robust  against  varia¬ 
tions  in  open-loop  dynamics.  The  linear-quadratic  state- 
feedback  regulator,  which  we  refer  to  as  the  LQSF  regula¬ 
tor,  is  considered.  The  robustness  of  LQSF  regulator 
designs  against  variations  in  open-loop  dynamics  is 
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measured  in  terms  of  multiloop  generalizations  of  the 
classical  notions  of  gain  and  phase  margin.  Like  classical 
gain  and  phase  margin,  the  present  results  consider 
robustness  as  an  input-output  property  characterizing 
variations  in  open-loop  transfer  functions  which  will  not 
lead  to  closed-loop  instability.  Variations  in  system 
parameters  (e.g.,  pole/zero  locations)  are  considered  by 
first  determining  how  these  variations  map  into  variations 
in  the  open-loop  frequency  response  matrix.  It  is  shown 
that  LQSF  multivariable  designs  have  the  property  of  an 
infinite  gain  margin  and  at  least  ±60°  phase  margin  for 
each  control  channel.  Similar  results  are  derived  for  non¬ 
linear  perturbations  in  the  feedback  loop. 

Such  robustness  results  may  appear  incorrect  at  first 
glance,  especially  to  control  engineers  familiar  with  classi¬ 
cal  servomechanism  design.  It  should  be  noted  that  in 
classical  servomechanism  design  the  nature  of  the  com¬ 
pensators  used  (e.g.,  lead-lag  networks)  generally  leads  to 
excessive  phase  lag  at  high  frequencies,  so  that  one  may 
never  have  the  infinite  gain  margin  property.  However,  it 
should  be  stressed  that  when  one  uses  full  stale-variable 
feedback  one,  in  effect,  introduces  a  multitude  of  phase- 
lag-correcting  zeros  in  the  compensator  without  introduc¬ 
ing  corresponding  lag-producing  poles.  It  is  this  abun¬ 
dance  of  zeros  together  with  the  linear-quadratic  optimal 
design  procedure  that  results  in  the  surprising  robustness 
properties  of  LQSF  designs. 

Exploiting  the  mathematical  duality  between  Kalman 
filters  and  linear-quadratic  optimal  feedback  controllers, 
the  authors  have  shown  that  the  robustness  results  of  this 
paper  lead  to  conditions  for  the  nondivergence  of  the 
estimates  generated  by  nonlinear  filters  of  the  type  consid¬ 
ered  by  Gilman  and  Rhodes  (33);  these  dual  results  will  be 
the  topic  of  a  future  publication.  In  contrast  to  the  results 
presented  here,  the  dual  nonlinear  filtering  results  require 
the  availability  of  an  exact  description  of  the  system 
under  consideration  and  hence  have  no  comparable 
robustness  interpretation.  It  can  be  shown  that  substitut¬ 
ing  the  nondivergent  state  estimate  from  this  type  of  filter 
for  the  true  state  in  a  nonlinear  state  feedback  regulator 
will  not  destabilize  the  closed-loop  system. 

In  order  to  provide  a  more  detailed  and  realistic  bridge 
between  the  classical  and  modern  approaches,  especially 
with  respect  to  robustness  issues,  one  has  to  examine  the 
case  in  which  not  all  state  variables  are  available  for 
feedback.  In  the  modem  control  approach,  one  would 
then  have  to  use  a  state  reconstructor  (Luenberger  ob¬ 
server  or  constant  gain  Kalman  filter).  The  overall  robust- 
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ness  properties  of  such  designs  are  not  entirely  settled  as 
yet;  they  will  be  addressed  in  a  future  publication.  Also 
there  are  interesting  and  as  yet  unresolved  issues  of  the 
robustness  properties  of  output  (or  limited-state)  variable 
feedback  designs  using  quadratic  performance  criteria 
1311. 

II.  Previous  Work 

The  fundamental  work  on  the  robustness  of  feedback 
systems  is  due  to  Bode  [1,  PP-  451-488].  Employing  the 
Nyquist  stability  criterion,  Bode  showed  how  the  notions 
of  gain  and  phase  margin  can  be  exploited  to  arrive  at  a 
simple  and  useful  means  for  charac  erizing  the  classes  of 
variations  in  open-loop  dynamics  which  will  not  destabi¬ 
lize  single-input  feedback  systems.  While  Bode’s  concern 
was  primarily  with  feedback  amplifiers  rather  than  control 
systems,  his  ideas  have  come  to  play  a  key  role  in  the 
design  of  control  systems.  The  control  engineering  im¬ 
plications  of  Bode’s  ideas  are  further  developed  by,  for 
example,  Horowitz  [2],  Although  the  Nyquist  criterion  has 
been  extended  to  multiloop  feedback  systems  [7]  and  [8], 
there  has  as  yet  been  only  limited  success  in  exploiting  ti.e 
multiloop  version  in  the  analysis  of  multiloop  feedback 
system  robustness  [9]-[14], 

Regarding  the  robustness  properties  specific  to  LQSF 
regulators,  perhaps  the  most  significant  result  is  due  to 
Anderson  and  Moore  [4,  pp.  70-76].  Exploiting  the  fact 
that  single-input  LQSF  regulators  have  a  return-difference 
greater  than  unity  at  all  frequencies  (15],  these  authors 
show  that  single-input  LQSF  regulator  designs  have  ±  60° 
phase  margin,  infinite  gain  margin,  and  50  percent  gain 
reduction  tolerance.  It  has  also  been  shown  that  the  gain 
properties  extend  to  memoryless  nonlinear  gains  of  the 
type  shown  in  Fig.  1  ((16]  and  [4,  pp.  96-98]).'  Related 
results  by  Barnett  and  Storey  [18]  and  Wong  [19],  [35] 
parameterize  a  class  of  linear,  constant  perturbations  in 
feedback  gain  which  will  not  destabilize  a  multiloop 
LQSF  regulator.  A  generalization  of  the  latter  result  to 
multiloop  nonlinearities  in  optimal  nonlinear  state-feed- 
back  regulators  with  quadratic  performance  index  is  in¬ 
correctly  attributed  to  [16]  by  [20].  Insofar  as  the  generali¬ 
zation  stated  in  [20]  applies  to  LQSF  regulators,  it  is 
essentially  equivalent  to  Theorem  1  of  this  paper. 

Various  other  results  have  been  produced  which  are 
more  or  less  indirectly  related  to  the  question  considered 
here.  Issues  related  to  the  inverse  problem  of  optimal 
control,  i.e.,  the  characterization  of  the  properties  of  opti¬ 
mal  systems,  are  considered  by  [15]  and  [20]-[24].  The 
question  of  sensitivity  in  LQSF  regulators  is  considered  by 
[!0[,  [15],  and  [25]-[28].  The  stability  conditions  of  Zames 
[29],  [30]  involving  loop  gain,  conicity,  and  positivity  have 
many  features  in  common  with  the  results  which  are 
presented  here. 

'Thu  rejull  is  attributed  by  AnJerson  [I6|  to  Sage  [I7|. 


Fig.  I.  Non  destabilizing  nonlinear  feedback  gain. 

III.  Definitions  and  Notation 

The  following  conventions  of  notation  and  terminology 
are  used: 

1)  A  T(x T)  denotes  the  transpose  of  the  matrix  A  (the 
vector  x). 

2)  A*  denotes  the  adjoint  of  the  matrix  A  (i.e.,  the 
complex-conjugate  of  A  r). 

3)  We  say  that  the  function  x:[0,  oo)-»R"  is  square-in- 
tegrable  if 

ll*ll2= fC°xT(e)x(t)dt<ao. 

Jo 

For  all  square-integrable  x,  the  quantity  ||x||  is  called  the 
norm  of  x. 

4)  The  term  operator  is  reserved  for  functions  which 
map  functions  into  functions.  For  example,  a  dynamical 
system  may  be  viewed  as  an  operator  mapping  input 
time-functions  into  output  time-functions. 

5)  We  say  that  an  operator  91  with  910  =*0  has  finite 
gain  if  there  exists  a  constant  k  <  oo  such  that 

||9l«||  <&||m|| 

for  all  square-integrable  u. 

6)  We  say  that  an  operator  mapping  input  time-func¬ 
tions  into  output  time-functions  is  nonanticipative  if  the 
value  assumed  by  the  output  function  at  any  time  t0 
depends  only  on  the  values  of  the  input-function  at  times 

t  <  Iq. 

7)  If  a  function  x:(0, » )-*R"  has  the  property  that 

lim  x(f)  =  0, 

f-»» 

then  we  say  that  x  is  asymptotically  stable.  A  system  of 
ordinary  differential  equations  is  asymptotically  stable  in 
the  large  if  every  solution  is  asymptotically  stable. 

8)  If  (5)  denotes  the  system  x(r)*=(?Fx)(/)  where  ^F0  - 
0,  we  say  that  the  pair  [//,S]  is  detectable  if  for  each 
x:[0,  oo)~*Rn  satisfying  (S)  with  x  not  square-integrable, 
Hx  is  also  not  square-integrable.  The  significance  of  de¬ 
tectability  is  most  apparent  if  we  consider  x(f)  as  a 
description  of  the  internal  dynamics  of  some  physical 
system  and  (//x)(7)  as  the  observed  output.  Viewed  in  this 
manner,  detectability  means  essentially  that  unstable  be¬ 
havior  in  the  system’s  internal  dynamics  always  results  in 
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an  output  which  is  unstable.  For  example,  if  H  is  a 
nonsingular  square  matrix,  then  (//,i']  will  be  detectable. 

9)  We  say  that  an  operator  mapping  time-functions 
into  time-functions  is  memoryless  if  the  value  assumed  by 
its  output  function  at  any  instant  tQ  depends  only  upon  i0 
and  the  instantaneous  value  of  the  input  function  at  time 
lo- 

10)  A  >0  (A  >  0)  is  used  to  indicate  that  the  matrix  A  is 
positive  definite  (semidefinite). 

11)  We  say  that  a  rational  transfer  function  P(s)  is 
proper  if  P(s)  has  at  least  as  many  poles  as  zeros. 

IV.  Problem  Formulation 

The  linear-quadratic-state-feedback  (LQSF)  regulator 
problem  can  be  formulated  as  follows: 


x*(i)  —  Ax*(t)  +  Bu*(t) 
**(/)-  R 


*«*(').  *%0)-x0\ 

=  -  R-'BrKx’{t)  j  {  ’ 


4ti*  -  Ar'gk 


nun/(j(,ii) 
subject  to 

x(r)-/4x(r)  +  Bi*(/),  x(0)  =  xo 

*(/)€  R”,  u(i)e Rm,  A  6  /?"*",  B  e  R" xm 

where  the  performance  index  J(x,u)  is  given  by 
J(x,u)-f~[xr(t)Qx(t)+uT{t)Ru(l)]dt 

q=qt> o,  R=Rt> 0. 


The  optimal  control  «*(/)  and  the  associated  optimal 
state-trajectory  x*(f)  are  given  by 


where  K  —  K  T  >  0  satisfies  the  Riccati  equation 

0-KA+AtK-KBR  ~'BtK+Q.  (3) 

The  minimal  value  of  the  performance  index  is 

J  (x*,«*)  —  XqKxq.  (4) 

The  class  of  systems  considered  here  are  perturbed 
versions  of  (2*)  satisfying 

£x(f)-,«(/)+(l>0l«)(/).  x(0)  =  x0j  (-) 

«(/)--  Nx(i) 

where  A,  B,  Xq,  and  H  are  the  same  as  in  (2*).  We  assume 
that  01  is  a  finite-gain,  nonanticipative  operator  with 
010-0  (see  Fig.  2).2 


2 The  condition  <X0»0  is  not  restrictive  since  we  can  always  consider 
the  dc  or  steady-state  effects  separately  as  is  common  engineering 
practice. 


|h  sff'8TS 


Fig.  2.  Perturbed  LQSF  regulator  (S). 

V.  Results 

The  two  theorems  which  follow  quantitatively  char¬ 
acterize  the  tolerance  of  (2)  to  perturbations  01.  It  is 
noted  that  the  significance  of  these  results  is  not  restricted 
to  systems  with  perturbations  originating  only  at  the  point 
shown  in  Fig.  2.  Rather,  it  is  only  necessary  that  the 
system  under  consideration  have  open-loop  input/output 
behavior  which  is  the  same  as  the  open-loop  behavior  of 
(2).  Both  of  the  theorems  which  follow  have  interpreta¬ 
tions  in  terms  of  generalizations  of  the  classical  notions  of 
gain  and  phase  margin.  The  proofs  are  given  in  the 
Appendix. 

Theorem  1  (LQSF  Multiloop  Nonlinear  Gain  Tolerance ): 
Let  the  perturbation  01  of  (2)  be  a  memoryless,  time- 
varying  nonlinearity 

(0U)(l)-/(«(f),f).  (5) 

If  there  exists  a  constant  ft  >  0  and  a  constant  k  <  ao  such 
that 

kuTu  >  uTf(R  - '«,/)>  ^~^~utR  ~'u  (6) 

for  all  u^Rm  and  all  f£(0, oo),  then 

J  (x*,«*)  >  [  x r{t)Qx  (f )  +  (to r(l)Ru  (f )  ]  dt  (7) 

and  if,  additionally,  ((?l/2,2]  is  detectable  then  (2)  is 
asymptotically  stable.  □ 

In  Theorem  1,  the  least  conservative  stability  result  is 
obtained  with  /?>=  0.  However,  in  this  case,  the  bound  (7) 
may  be  more  conservative  than  necessary. 

Theorem  2  (LQSF  Multiloop  Gain  and  Phase  Margin): 
Let  the  perturbation  0L  of  (2)  be  a  finite-gain,  linear¬ 
time-invariant  operator  £  with  rational  transfer  function 
matrix  L(s).  If  for  all  <•> 

L(ju)R  -'  +  If  ~'L*(ju)-R  “'>0  (8) 

and  if  [Qi/2,2]  is  detectable,  then  (2)  is  asymptotically 

stable.  □ 

The  results  of  Theorems  1  and  2  apply  only  in  situa¬ 
tions  where  the  perturbation  01  is  either  memoryless  or 
linear  lime-invariant.  While  this  covers  many  interesting 
situations,  these  are  not  the  most  general  results  possible. 
In  (34,  Appendix  B]  it  is  shown  that  the  stability  condi¬ 
tions  of  Theorems  1  and  2  are  actually  special  cases  of  a 
more  abstract  result  concerning  t(je  input/output  stability 
of  a  class  of  systems  including  (2)  as  a  special  case.  The 
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possibility  of  nonlinear  time-varying  dynamical  perturba¬ 
tions  in  the  A  -matrix  is  also  considered. 

It  is  noted  that  conditions  (7)  and  (8)  may  be  difficult  to 
verify  in  general,  requiring  ingenuity  and  perhaps  the  aid 
of  a  digital  computer.  Likewise,  the  condition  of  detecta¬ 
bility  may  not  be  easy  to  verify  rigorously,  though  physi¬ 
cal  considerations  may  often  make  detectability  a  virtual 
certainty.  In  the  next  section,  a  special  case  is  considered 
in  which  detectability  is  assured  and  (7)  and  (8)  are 
relatively  easy  to  verify. 

VI.  Discussion 

Theorems  1  and  2  characterize  a  wide  class  of  varia¬ 
tions  in  open-loop  dynamics  which  can  be  tolerated  by 
LQSF  regulator  designs.  To  appreciate  the  significance  of 
these  results  and,  in  particular,  their  relation  to  classical 
gain  and  phase  margin,  it  is  instructive  to  consider  the 
special  case  depicted  in  Fig.  3  in  which 

Q>  0  (9) 

r,  0  •••  0 

tf=diag  (r„- ••,/•„)=  0  r2  ■■  0  (10) 

0  O'  ■  rm 

and  the  perturbation  91  satisfies 

%»«  •  (11) 

9L"“". 

so  that  the  perturbations  in  the  various  feedback  loops  are 
noninteracting.  Condition  (9)  ensures  that  [£)'/J,2]  is 
detectable  and  (10)  and  (II)  simplify  the  verification  of 
conditions  (7)  and  (8). 

In  this  case  Theorem  1  specializes  to  the  following. 

Corollary  3:  If  the  perturbed  system  (2)  satisfies 
p'H  II),  if  each  of  the  perturbations  %  is  memory  less 
with  and  if  for  some  k<oo ,  some 

P  >0,  and  all  re[0,oo), 

M0,t)-0  (12a) 

*>^/,(M)>-^y- ,  for  all  u^O  (12b) 

-  V 

(see  Fig.  I),  then  (2)  is  asymptotically  stable  in  the  large 
and  (7)  holds.  q 

Proof:  This  follows  immediately  from  Theorem  1.  □ 

If  we  consider  the  case  in  which  the  %’s  of  the  system 
in  Fig.  3  are  linear  time-invariant  operators,  then  Theo¬ 
rem  2  becomes  Corollary  4. 

Corollary  4:  If  the  perturbed  system  (2)  satisfies 
(9MH)  and  if  each  of  the  perturbations  %  is  linear¬ 
time-invariant  with  proper  rational  transfer  function  P(s). 


Proof:  The  condition  Re[s,)<0  assures  that  91  has 
finite  gain.  Taking  L(s)  =  diag(P,(s)),  the  result  follows 
immediately  from  Theorem  2.  □ 

From  Corollary  3,  it  is  clear  that  the  sufficient  condi¬ 
tion  for  stability 

(13) 

proved  in  [4,  pp.  96-98)  and  [16]  for  single-input  LQSF 
regulators,  generalizes  to  multiloop  systems  when  R  = 
diag(r,,.  ■  ■  ,rj. 

From  Corollary  4,  the  following  two  results  follow 
directly. 

Corollary  5  (LQSF±  60°  Multiloop  Phase  Margin):  If  Q 
and  R  satisfy  (9)  and  (10),  then  a  phase  shift  with 
|«f»,|<60°  in  the  respective  feedback  loops  of  each  of  the 
controls  m,  will  leave  an  LQSF  regulator  asymptotically 
stable  in  the  large.  □ 

Proof:  Take  Flt/w)«e*,<").  From  Corollary  4,  we 
require  cos<>1(«)>  ior  |£,(«)| < cos~'(l/2)=-60°.  □ 

Corollary  6  (Multiloop  LQSF  Infinite  Gain  Margin  and 
50  Percent  Gain  Reduction  Tolerance):  If  Q  and  R  satisfy 
(9)  and  (10),  then  the  insertion  of  linear  constant  gains 
a,  >  |  into  the  feedback  loops  of  the  respective  controls  u, 
will  leave  an  LQSF  regulator  asymptotically  stable  in  the 
large.  Q3 

Proof:  Follows  trivially  from  Corollary  4.  □ 

Corollaries  5  and  6  are  obvious  multiloop  generaliza¬ 
tions  of  the  previously  established  result  [4,  pp.  70-76) 
that  single-input  LQSF  regulators  have  infinite  gain 
margin,  at  least  ±60°  phase  margin,  and  at  least  SO 
percent  gain  reduction  tolerance. 

VII.  Conclusions 

Resuhs  have  been  generated  which  quantitatively  char¬ 
acterize  a  wide  class  of  variations  in  open-loop  dynamics 
which  will  not  destabilize  LQSF  regulators.  A  ±60°  phase 
margin  property  of  LQSF  regulators  has  been  established 
for  multiloop  systems  (Corollary  5).  The  class  of  nonde- 
stabilizing  linear  feedback  perturbations  for  multiloop 
LQSF  regulators  has  been  extended  to  include  dynamical, 
transfer-function  perturbations  (Theorem  2).  A  nonlinear¬ 
ity  tolerance  property  for  LQSF  regulators  has  been 
proved  (Theorem  I).  An  upper  bound  on  the  performance 
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established  [(7)  of  Theorem  I  and  Corollary  3|.  The  latter 
result  can  be  interpreted  as  a  measure  of  the  stability  of  a 
perturbed  LQSF  regulator  in  comparison  with  the  unper¬ 
turbed  regulator.  The  process  of  generating  these  results 
has  brought  pertinent  previous  results  (4,  pp.  70-76. 
96-98],  (16],  [18)— [20]  together  under  a  unified  theoretical 
framework. 

The  results  presented  show  that  modern  multiloop 
LQSF  regulators  have  excellent  robustness  properties  as 
measured  by  the  classical  criteria  of  gain  and  phase 
margin,  thus  strengthening  the  link  between  modern  and 
classical  feedback  theory.  Additionally,  these  results  show 
that  multiloop  LQSF  regulator  designs  can  tolerate  a  good 
deal  of  nonlinearity.  The  quantitative  nature  of  the  results 
suggests  that  they  may  be  useful  in  the  synthesis  of  robust 
controllers. 

Although  the  results  presented  all  specify  that  the  toler¬ 
able  perturbations  be  measured  with  respect  to  a  perfect 
state-measurement  LQSF  system,  it  is  apparent  that  state¬ 
ments  may  also  be  made  about  the  general  LQG  regulator 
if  the  effect  of  the  Kalman  filter  on  the  system’s  open- 
loop  dynamics  is  viewed  as  a  component  of  the  perturba¬ 
tion  01. 

Appendix 


Proofs  of  Theorems  1  and  2 


We  begin  by  introducing  the  following  notation  to 
facilitate  the  proofs. 

1)  The  inner-product  space  L£(0,  oo)  is  defined  by 


LjfO.oo)-  |x|x:  [0,oo)-»fl",  j  xT(i)x(i)di  <  oc  | 

(Ala) 

<*.T>- / V(f)y(t)rft.  (Alb) 

■'0 

2)  The  extension  £.£,[ 0,oo)  of  L"[0,oo)  is  defined  by 
Li[0,oo)-|x|x:[0,oo)-*/l", 


f  xT(t)x(t)dt<  oo  for  all  r  j  (A2a) 


if  the  integral  (Alb)  converges 
otherwise. 


(A2b) 


3)  The  linear  truncation  operator  0*, :  oo)-» 

2.2(0,00)  is  defined  by 


(tfTxX0-f  ,r,e[°’T]  (A3) 

0,  otherwise. 


For  brevity  of  notation  we  denote  <?rx  by  x,. 

The  key  result  in  the  proofs  of  Theorems  I  and  2  is  the 
following. 


for  •><  mie  />’  >  0 

yii,(20l -(IT P)I)R-  '«>>0  (A4) 

for  all  ire/.ffO,  00),  then  1) 

x07Ax0><x.Qx>  +  /?<«,!?«>  (A5) 

where  x,ii  is  the  solution  of  (2),  and  2)  if,  additionally, 
!(?'  J,2]  is  detectable,  then  x  is  asymptotically  stable  and 
square-integiable. 

Proof:  For  X  the  solution  of  (3)  and  x  the  solution 
of  (2)  with  x(0)  =  x0,  we  have  that  for  every  r  £]0,  00) 

Xx0—  r r ( t)Kx (t ) -  jf  ~i(xT(l)Kx(t))dt 

*  x  T(r)Xx  (t)  -  2<ffxT,  (A  -  B%R  ~  'B rK  )xT> 

>  -  2<xt,  K  ( A  -  B  <%R  ~  lB  rK  )xT> 

*  (xr,(KB(2%  -  I)R~lBTK+Q)xJ').  (A6) 

Using  (A4)  and  the  fact  that  u=  -R~  xBTKx.  we  have 

*0**0  - '  v  r> 

> <XT, KB (201  -  (I  +/?)/)/? - ]BTKxr > 

=  <BTKx„( 2%  -  (I  +  p)l)R~  'BTXxr> 

>0.  •  (A7) 

Rearranging  and  taking  the  limit  t  -»oc,  (A5)  follows. 
Now,  suppose  for  the  purpose  of  argument  that  x  is  not 
square-integrable  Since  [Q  l/7,2]  is  detectable,  this  means 
(Q,/2x Q1'7*,  increases  without  bound  as  r  increases, 
contradicting  (A5).  Therefore,  x  is  square-integrable.  By 
hypothesis  ^  and  hence  A  - B<fKR~xBTK  have  finite 
gain.  Thus,  x~(A  -  B0i  R  ~'BrK)x  is  also  square-inte¬ 
grable.  Since  both  x  and  i  are  square-integrable.  it  follows 
(cf.  (32, pp.  235-37])  that  i  is  asymptotically  stable.  □ 
Proof  of  Theorem  1:  Equation  (6)  ensures  that  (A4)  js 
satisfied.  Since,  for  memoryless  0T,  x  is  the  state  of  (2) 
and  since  the  initial  time  r*=0  is  not  distinguished,  the 
asymptotic  stability  in  the  large  of  (2)  is  assured  if  x  is 
asymptotically  stable  for  every  initial  state  x(0)-x0.  The¬ 
orem  1  follows  from  (4)  and  Theorem  Al.  □ 

Proof  of  Theorem  2:  From  (8)  and  Parseval’s  theorem 
it  follows  that,  for  every  uG  TJfi.  00) 

<«,(20i  -/)*-•«> 

=  <«,(2P  "/)*-'«> 

+  R  -  -  K  - 1  )0l (ju)du 

>0  (A8) 

where  01  (ju>)  is  the  Foutier  transform  of  u.  Thus,  (A 4)  is 
satisfied  with  ftm0.  Since  |0l/,.2)  is  detectable.  Theorem 
Al  implies  that  x  is  asymptotically  stable,  regardless  of 
the  value  of  x0.  It  follows  that  the  weighting  pattern  f V(i) 
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(i.e.,  the  response  of  (2)  to  an  impulse  l„S(i)  where  8(t)  is 
the  Dirac  delta  function)  is  asymptotically  stable.  Thus, 
provided  there  are  no  unstable  modes  which  are  uncon¬ 
trollable  or  unobservable,  the  closed-loop  system  is 

asymptotically  stable  in  the  large.  Such  modes  correspond 
to  “pole-zero  cancellations”  in  the  Laplace  transform  of 
H'(f). 

+  (A9) 

The  dynamics  of  (2)  are  described  (not  necessarily 
minimally)  by  the  differential  equations 

h-A  -B  lfil 

L„(s)R-'BtK  f-fl(s)  j[  m  J ~°  (A10) 

where  s**d/dt,  LN(s)  and  LD(s)  are  polynomial  matrices 
satisfying  £(j)**  Lp  \s)L,Xs),  and  the  roots  of  det(i0(s)J 
are  the  poles  of  L(s).  For  (2)  to  be  asymptotically  stable 
in  the  large,  we  require  that  the  roots  of  the  characteristic 
polynomial  p(s )  associated  with  (A  10)  all  have  negative 
real  parts.  Using  a  well-known  matrix  identity,  we  have 
from  (A9)  and  (A  10) 


,  \ls-A  -B 

P(S)~ del  Ln(s)R~'BtK  Ld(s) 


‘del  [  LD(s)]-det  [  Is  -  A  +  BL(s)R  ~  'BrK] 
det  [Ld(s)J 
detf^j)] 


and  therefore 


det  [  ■sZir(  j)  ]  = 


det[iD(s)] 


Now,  from  standard  results  on  linear  systems  we  have 
that  IV(t)  is  of  the  form 

^(0-  2  c,oy  (A  13) 

where  C)(f)  are  nonzero  matrices  of  polynomials  in  t  and 
the  set  £(W)  satisfies 


P ( tV)  -  Z  (  W)  Q  t’(  W )  C  P  ( W ) 
where,  in  view  of  (A  12), 

zmsfaldetlMOj-O} 


(A  14) 


(We  call  the  members  of  Z(W)  and  P(W).  respectively, 
the  zeros  and  the  poles  of  ^'(s).)  Since  W{t)  is  square-in- 
tegrable, 

Re[i,J<0,  for  all  j,ec'(fF).  (A  15) 
From  (AI2)  and  (AI4)  it  follows  that  rvivru  for  roots 


that  all  the  roots  of  det(i0(s)]  have  negative  real  parts. 
Thus  any  cancellations  in  (A  12)  can  involve  only  roots 
with  negative  real  parts.  We  conclude  that  alt  the  roots  of 
the  characteristic  polynomial  p(s)  have  negative  real  parts, 
and,  hence,  (2)  is  asymptotically  stable  in  the  large.  □ 
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Optimal  Low-Sensitivity  Linear  Feedback  Systems* 

Systemes  lineaires  a  reaction  a  sensibilite  optimalement  faible 

Optimale  lineare  Feedback  systeme  geringer  Empfindlichkeit 

JlHHeHHbie  CHCTeMbi  c  o6paTHoii  CB«3bio  HMeiomHe  onTHMaJibHOMajiyio 

HyBCTBHTeJlbHOCTb 

H.  KWAKERNAAK1 

By  choosing  in  the  stochastic  linear  regulator  problem  the  matrix  which  weights  the 
input  as  the  zero  matrix,  feedback  filters  may  be  obtained  which  make  the  closed-loop 
system  insensitive  in  the  sense  of  Cruz-Perkins. 


Summary  The  paper  considers  the  stochastic  linear 
regulator  and  tracking  problem  for  multivariable  time- 
invariant  systems.  It  is  shown  that  in  the  limiting  case,  where 
the  matrix  weighting  the  input  in  the  quadratic  criterion  is 
the  zero  matrix,  the  closed-loop  system  is  insensitive  to 
parameter  variations  in  the  sense  of  Cruz-Perkins,  provided 
that  the  system  to  be  controlled  is  minimum-phase.  The 
weighting  matrix  in  the  Cruz-Perkins  sensitivity  criterion 
turns  out  to  be  the  inverse  of  the  covariance  matrix  of  the 
measurement  noise.  A  simple  example  illustrates  the  de¬ 
crease  of  sensitivity  obtained  for  a  system  with  two  inputs 
and  two  outputs. 

1.  INTRODUCTION  AND  MOTIVATION 
Kalman’s  optimal  linear  control  and  filtering 
theory  (Kalman  [1],  Kalman  and  Bucy  [2], 
Wonham  [3])  make  it  possible  to  design  multi- 
variable  linear  feedback  systems  which  exhibit 

(a)  Overall  system  stability; 

(b)  Optimal  transient  behavior; 

(c)  Optimal  immunity  against  disturbances  and 
noise. 

It  is  the  purpose  of  this  paper  to  demonstrate 
that  in  addition  to  these  a  fourth  objective  may  be 
achieved,  namely 

(d)  Insensitivity  to  parameter  variations. 

In  the  literature  a  number  of  papers  have  ap¬ 
peared  on  the  design  of  low-sensitivity  linear  feed¬ 
back  systems  by  state  space  techniques  (Anderson 
[4],  Porter  [5],  Herner  [6],  Kahne  (7),  Tuel  et  al. 


*  Received  17  September  1968  and  in  revised  form  23 
December  1968.  The  original  version  of  this  paper  was 
presented  at  the  IFAC  Symposium  held  in  Dubrovnik, 
Yugoslavia  in  August  1968.  It  was  recommended  for 
publication  by  associate  editor  P.  Kokotovic 

t  Department  of  Mathematics  and  Department  of  Applied 
Physios,  University  of  Technology  (Technische  Hogeschool), 
Delft,  Netherlands. 


[8],  Rao  et  al.  [9],  and  others).  It  seems  not  to  have 
been  noted,  however,  that  by  choosing  the  weighting 
matrix  for  the  input  in  the  quadratic  criterion  for  the 
stochastic  regulator  problem  very  small,  low-sen¬ 
sitivity  controllers  may  be  obtained  for  time-invar¬ 
iant  minimum-phase  systems.  This  idea  is  developed 
in  this  paper  and  an  example  is  presented  which 
shows  how  this  property  may  be  exploited. 

2.  REVIEW  OF  STOCHASTIC  LINEAR  OPTIMAL 
CONTROL  THEORY 

Consider  a  linear  time-invariant  system  described 


by  the  following  equations 

x(t)  =  Ax(t)  +  Bu(t)  +  v(t)  (1) 

z(t)=Dx(t)  (2) 

y(t)—Cx(t)+w(t)  *  (3) 

E(v(ti)v(t2)')^Ncd{ti-t2)  (4) 

E(w(r,)w(t2)')=Nw6(t1  — f2).  (5) 


Here  x(t)  is  the  state  of  the  system;  v(f)  and  w(t) 
are  uncorrelated  multidimensional  white  noise 
processes,  with  zero  mean;  A,  B,  C,  D,  Nv  and 
Nw  are  constant  matrices;  the  prime  denotes  the 
transpose.  Furthermore  z(f)  indicates  the  output 
to  be  controlled ;  y(r)  is  the  observed  output. 

It  is  well-known  [3]  that  an  optimal  estimate 
v(0  of  the  state  may  be  obtained  as  follows 

*(t)=(A-PC'N;lC,  Bu(t)+PCN~ly(t)  (6) 

where  P  is  the  asymptotic  solution  for  f-»co  of  the 
matrix  Riccati  equation 

P(t)  -  -  P(t)C' N; 1  CP(f)  +  APil) + P(i)A'  +  N, , 

*M-0.  (7) 
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If  the  system  is  to  be  controlled  such  that 


This  is  the  case  if 


£[2(«)'z(I)+u(0'Lu(0]  (8) 


det  [D(s/  -A+ PC'N~ 1  C)~ 1 B] 


is  minimal  (L  is  a  weighting  matrix)  the  input  must 
be  chosen  as 

u(t)=-L~1B'Q*(  t)  (9) 

where  Q  is  the  asymptotic  solution  of  another 
matrix  Riccati  equation  [1]. 

In  this  paper  the  main  interest  is  in  feedback 
controller  which  is  optimal  for  L=0.  This  may  be 
found  as  follows.  Suppose  that  r(t)  is  an  external 
reference  input  for  the  controlled  output  z(t), 
and  consider  the  criterion 

£{[z(0-K0]’tz(i)-K0]}.  00) 

it  is  not  difficult  to  show  that  this  is  minimized  if 
the  system  is  controlled  such  that 

f(t)=r(0  for  all  t  (11) 

where  2(t)  is  the  conditional  expectation  of  ;(<) 

given  all  past  observations  of  the  measured  output. 
Since  $(t)=Dx(t)  condition  (11)  may  be  expressed 
in  terms  of  Laplace  transforms  by  eliminating 
i(r)  from  (6)  after  Laplace  transformation.  It 

follows,  assuming  zero  initial  conditions, 

D(sI-A+PCN~  iC)~l[BV(s)+PC'N~  ‘  Y(s)] 

=  R(5).  (12) 

Bold  capitals  indicate  the  Laplace  transforms  of  the 
corresponding  lower  case  time-functions. 

One  can  solve  U(s)  from  this  equation  if  u(t),  z(t ) 
and  r(i)  have  the  same  dimension.  If  the  dimension 
of  u(t )  is  smaller  than  that  of  z(t)  and  r(t),  generally 
no  solution  exists  which  satisfies  (12)  for  all  .v. 
If  the  dimension  of  u(t)  is  greater  than  that  of  z(t) 
and  r(t )  many  solutions  exist  and  the  problem 
may  be  modified  by  increasing  the  number  of 
outputs  to  be  controlled.  Assuming  that  u(i ), 
z(r)  and  r(t)  have  the  same  dimension  one  finds 

U(s)--G(j)Y(s)+J/(s)R(s)  (13) 

where 

G(a)—[D(sI-A+PC'N~iC)~1Byi 

D(sl~A+PC'N^tC)~iPC'N~l  (14) 

H(a)^[D(s!-A  +  PC'N-lQ-lByx.  (15) 

This  solution  is  valid  provided 

lD(s/—A+PC'N~lC)~iB']~l 
exists  (except  at  a  finite  number  of  values  of  s.) 


does  not  vanish  identically  in  s  as  indicated  in 
Brockett  and  Mesarovic  [1 5],  For  the  case  where 
C=  D,  where  the  observed  output  is  precisely  the 
controlled  output,  a  condition  for  this  may  be  found 
as  follows.  After  some  manipulations  involving  the 
relation  (A. 2)  one  obtains 

det  [DisI-A+PC'Niy'O-'B] 

_  det[D(s/  —  A)~l  B]det(s/  -  A)  .j,  . 

det  (sI-A+PD'N^D)  1  ’ 

It  immediately  follows  that  the  inverse  exists 
provided  det[  £>($/— A)~lB]  does  not  vanish 
identically  in  s.  If  C^D  it  does  not  seem  easy  to 
find  such  an  explicit  condition. 

The  system  arrangement  is  shown  in  Fig.  1. 
In  section  3  it  will  be  investigated  under  which 
conditions  the  feedback  filter  G(s)  is  indeed  optimal 
and  can  be  considered  as  the  limit  filter  for  L-* 0. 
In  section  4  it  will  be  shown  that  this  filter  possesses 
an  interesting  property  with  respect  to  the  system 
sensitivity  to  parameter  variations. 
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Fir,.  I.  Basic  system  configuration. 


3.  STABILITY 

For  the  feedback  arrangement  of  Fig.  1  one 
can  write  for  the  input  to  the  system 

U(s)=  -G(s)Y(a)+H(s)R(s)+V0(s)  (16) 

where  U0(s)  represents  the  combined  effects  of  the 
initial  conditions  of  feedback  filter  and  prefilter. 
By  Laplace  transformation  of  (1)  (2)  and  (3)  one 
can  derive 

U = (/+  GG)-  ‘  HR  -  (/  +  G«»r 1  C^(V + x0) 
-(f+C®)-‘CW+(/+G«r,Uo  (17) 

Z =«>,(/+  G4>)~lHR 

+[%-Ql(I+G*r1GVXV+Xo) 

-«b,(/+  GO)"1  GW +$,(/+ GffO^Uo  (18) 

where  the  Laplace  variable  s  has  been  omitted, 
x0  is  the  initial  state  of  the  system,  and 

0(j )=C(sI-A)-tB,  ¥(*) -C(sl-A)~l 

*,(j )=Disl-A)-*B,  %(j)m D(sl-A)~l.  (19) 
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From  these  relations  it  is  shown  in  Appendix  A 
that  the  control  system  is  stable  if  the  following, 
sufficient,  conditions  are  satisfied : 

(i)  The  system  x  =  Ax  +  Bu  is  completely  control¬ 
lable; 

(ii)  The  system  x=Ax,  y=Cx  is  completely 
observable; 

(iii) One  can  write  N,=FN0F',  where  A'0  is  a 
constant  positive-definite  matrix  a.id  F,  a 
constant  but  not  necessarily  square  matrix, 
such  that  the  system  x  —  Ax  +  Fu  is  completely 
controllable; 

(iv)  The  system  x=Ax+Bu,  z  =  Dx  is  minimum- 
phase,  i.e. 

det[D(s/— v4)~  *B]  (20) 

has  all  of  its  zeroes  in  the  left  half  complex 
plane; 

(v)  The  system  x—Ax,  z  =  Dx  is  completely 
observable; 

(vi)  A  minimal  realization  [10]  is  used  to  implement 
the  joint  transfer  matrix  [-G(s),H(s)]  of  the 
prefilter  and  feedback  filter. 

The  most  restrictive  of  these  requirements  seems  the 
minimum-phase  property  (iv).  It  is  well-known  [11] 
that  the  optimal  feedback  law  (9)  always  yields  a 
stable  feedback  system  if  the  conditions  (i),  (ii), 
(iii)  and  (v)  are  satisfied.  Therefore  the  minimum- 
phase  property  is  the  extra  requirement  which  is 
needed  to  ensure  that  (14)  is  indeed  the  limiting 
feedback  filter  for  L-* 0  which  results  from  the 
optimal  control  law  (9)  in  conjunction  with  the 
optimal  filter  (6). 

4.  SENSITIVITY  TO  SYSTEM  VARIATIONS 
It  is  shown  in  this  section  that  the  feedback 
filter  (14)  makes  the  control  system  insensitive 
to  parameter  variations.  The  approach  which  is 
taken  to  sensitivity  is  that  of  Cruz  and  Perkins  [12]. 
Feedback  can  only  effectively  reduce  the  sensitivity 
of  the  control  system  if  the  controlled  output  itself 
is  fed  back.  Consider  therefore  the  configuration 
of  Fig.  2  and  suppose  that  the  system  transfer 
matrix  changes  to  $(j)=4>(£)+A«I>C0-  Let  AZ e(s) 
denote  the  corresponding  change  of  the  closed-loop 

Rtf«rtnc« 


Fvtdback 

filter 


Fio.  2.  System  configuration  for  sensitivity  study. 


system  response  to  a  given  command  signal.  Let 
AZ0(s)  denote  the  corresponding  change  of  response 
of  an  open-loop  configuration  consisting  of  a  filter 
K(s)  in  series  with  the  system  such  that  the  nominal 
overall  transfer  matrix  K(s)<l>(s)  is  precisely  the 
nominal  overall  transfer  matrix  of  the  closed-loop 
system.  Cruz  and  Perkins  have  demonstrated  that 
AZc(r)  and  A Z0(s)  are  related  by 

AZr(s)  =  S(s)AZ0(s)  (21) 

where  the  sensitivity  matrix  S(s)  is  given  by 

S(s)  =  [/+^(S)G(S)]-‘.  (22) 

To  measure  the  difference  in  sensitivity  of  the 
closed-loop  and  the  open-loop  system  the  quantity 

E[Az(t)'RAz(t))  (23) 

may  be  used,  where  R  is  some  nonnegative-definite 
matrix.  If  A z0(t)  is  a  stationary  random  process, 

E[Azc(l)',RAzc(t)] 

=  trjj”  [S(  —j2nf)'RS(J2nfy]  V  0(/)d/ 1  (24) 

where  V0 (/)  is  the  power  spectral  density  matrix 
of  Azu(f)  and  tr  denotes  the  trace  of  a  matrix. 
Similarly  one  finds 

KW)d/J.  (25) 

Now  suppose  that 

S( -j2n f)'RS(J2n f)£R  for  all /  (26) 

i.e.  the  matrix  S(-j2nf)'RS(j2nf)—R  is  non¬ 
positive-definite  for  all  frequencies.  The  spectral 
density  matrix  V0(f)  is  Hermitian;  by  expanding  it 
in  terms  of  its  eigenvectors  it  is  not  difficult  to 
show  that  (26)  implies 

tr{S(-j2nf)'RS(j2nf)V0(f)}^tr{RV0(f)} 

for  all  / .  (27) 

This  means  that  if  (26)  is  satisfied 

E[Az,(0'KAz,(r)]  £  E[Azo(0'*Azo(0].  (28) 

Thus  relation  (26)  is  a  sufficient  condition  for  the 
reduction  of  the  sensitivity  of  the  closed-loop 
system  as  compared  to  the  open-loop  system  to 
variations  in  the  system  transfer  matrix  for  all 
types  of  command  signals. 
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It  is  known  from  the  work  of  Kalman  [I  I]  and 
Kreindler  [16]  that  the  deterministic  optimal  linear 
regulator  possesses  excellent  sensitivity  character¬ 
istics  in  the  sense  that  a  criterion  of  the  form  (26) 
is  satisfied.  It  is  very  easy  to  show  by  a  counter¬ 
example,  however,  where  a  simple  one-dimensional 
system  suffices,  that  for  the  stochastic  optimal 
regulator  a  condition  of  the  form  (26)  does  not 
generally  hold  for  all  frequencies.  In  the  following 
it  will  be  shown  that  a  condition  of  the  form  (26) 
is  satisfied  for  the  proposed  feedback  filter  of 
section  3  which  has  been  obtained  for  the  limiting 
case  L  =  0. 

To  apply  the  Cruz-Perkins  approach  to  the 
system  of  section  3,  it  is  assumed  that  in  the 
configuration  of  Fig.  1  the  observed  output  includes 
the  controlled  output  in  the  sense  that  the  matrix 
C  and  correspondingly  Nw  can  be  partitioned  as 


Accordingly,  the  transfer  matrix  of  the  filter  G(s) 
can  be  written  as 

G(s)=[G1(S)GJ(s)]  (30) 

with 

G,(s) -  [D(sl  -  A  +  PC'N- lQ~ 1 B] " 1 

D(sI-A+FC'N;tC)-,PD’N ~i  (31) 

G2(j)  =  [D(s/— A  +  PC'N~  ‘C)”  ‘B]  ~ 1 

DisI-A+PCNZ'CV'PM  N^ .  (32) 

The  system  has  a  main  feedback  loop  with  G,(s) 
and  a  minor  loop  with  G2(s).  (Fig.  3)  For  the 
purpose  of  studying  the  sensitivity  the  minor 
combined  with  the  plant  to  a  block  with  overall 
loop  is  transfer  matrix 

®i(5)[/+ G1(s)®2(s);r  (33) 

where 

<J>,(s)  =  D(s/— i4)-lfl, 
4»2(j)-M(s/-A)"'B.  (34) 

The  sensitivity  matrix  for  this  configuration  thus 
has  the  form 

S(j)-{/+®I(»)t/  +  G2(s)fl»2(s)]-‘G1(J)}-1 .  (35) 

The  sensitivity  matrix  will  be  studied  at  the  nominal 
value  of  the  system  transfer  matrix  rather  than 
at  the  actual  value  on  the  basis  of  the  assumption 
that  the  deviations  from  the  nominal  value  arc 


relatively  small.  It  is  shown  in  Appendix  B  that 
for  the  proposed  G,(.t)  and  C2(s)  the  sensitivity 
matrix  takes  the  form 

S(s)  =  [/+ D(sl  -A  +  PM'NZiMY  lPD'N ;‘]  - 1 . 

(36) 

Starling  from  the  Riccati  equation  (7)  for  the 
asymptotic  variance  matrix  P,  it  is  also  derived 
in  Appendix  B  that  the  sensitivity  matrix  satisfies 
the  inequality 

S(  —j2nf)'N ~iS(j2nf) ii N for  all/.  (37) 

This  is  a  relation  of  the  form  (26),  which  demon¬ 
strates  that  if  N~}  is  used  as  the  weighting  matrix 
in  the  sensitivity  criterion,  the  feedback  filter  pro¬ 
posed  in  section  3  decreases  the  sensitivity  of  the 
control  system  to  variations  in  the  system  transfer 
matrix. 

The  fact  that  the  weighting  matrix  R  should  be 
chosen  as  N~,1  is  not  entirely  surprising.  If,  for 
the  sake  of  argument,  Nwl  is  supposed  to  be 
diagonal,  a  small  value  of  one  of  the  diagonal 
elements  means  that  the  measurement  errors  at  the 
corresponding  output  are  small  and  consequently 
the  admissible  gain  in  the  associated  feedback  loop 
will  be  high.  The  effects  of  system  variations  will 
therefore  be  smaller  at  this  output  than  at  other 
outputs.  This  is  reflected  in  a  correspondingly 
large  weighting  factor  in  the  sensitivity  criterion. 


5.  DISCUSSION 

In  the  preceding  sections  it  has  been  shown  that 
by  letting  the  weighting  matrix  L  go  to  zero, 
feedback  filters  may  be  obtained  which  reduce  the 
sensitivity  of  the  system,  provided  the  system  is 
minimum-phase.  Since  the  feedback  and  feed¬ 
forward  filters  (14)  and  (15)  usually  are  different¬ 
iating  filters,  it  is  practical  to  use  a  feedback  filter 
which  is  optimal  for  a  suitably  small  L.  Just  how 
small  L  should  be  can  be  determined  by  considering 
the  extra  poles  which  are  introduced  into  the  feed¬ 
back  filter.  Choosing  L  >  0  will  cause  the  sensitivity 
reduction  criterion  (26)  to  be  violated,  usually 
in  the  high  frequency  range,  without  a  great  loss 
of  system  performance,  however. 

It  is  clear  that  immunity  to  disturbances  and  noise 
and  insensitivity  to  parameter  variations  cannot  be 
controlled  independently.  Both  are  determined  by 
the  choice  of  N„  and  Nw.  In  practical  applications 
these  quantities  must  be  manipulated  to  obtain 
results  which  are  in  both  respects  satisfactory. 

The  problem  of  choosing  a  practical  prefilter 
H(s)  is  not  difficult  and  is  not  considered  here. 


Optimal  low-sensitivity  linear  feedback  systems 


283 


The  nominal  parameter  values  are  A ,  =  A2  =  I . 
The  disturbances  are  represented  as  white 
noise  n  with  covariance  matrix  Nm  which  is 
added  to  the  input  u.  For  the  calculations  N„ 
was  chosen  as  the  identity  matrix.  Numerical 
solutions*  were  obtained  for  the  cases 

/O005  0  x 

w  V  0  0  05 /  • 

(case  2) 

(39) 


(case  1) 


For  the  first  case  the  solution  was  found  to  be 

/ 0-488 1  4-445  \ 

C(  )=\3-662  0-4881 ) 

u,  .  (  0-4881  s  + 4-445  \  .... 
H(s)=(s  +  4-662  -  0-5119}  (40) 


The  solution  of  the  second  case  is 


r. .  (  2-354  4-410  \ 

G(5)  }l3-32  0-2354/ 

.  /  2-354  s +4-410  \  .... 

W(5)=(s+14-32  -  0-7646}  <4,) 


There  is  no  need  to  introduce  extra  poles  into 
the  feedback  filter  since  it  does  not  contain  any 
differentiating  elements.  The  differentiating 
character  of  the  prefilter  can  be  eliminated  by 
simply  omitting  the  terms  with  s  in  the  transfer 
matrix  //(*);  this  is  equivalent  to  introducing 
two  far-off  poles  into  the  off-diagonal  terms  of 
the  prefilter  transfer  matrix.  Figure  4  shows 
the  matrix  of  step  responses  for  both  cases  for 
different  values  of  the  gains  A,  and  k2  as 
obtained  by  analog  computer  simulation.  It 


Fig.  3.  Detailed  system  configuration. 


Case  2 

Fig.  4.  Matrix  of  step  responses  of  feedback  system 


Curve  I :  Nominal  gains.  Art  =*2=  • 
Curve  2:  Halved  gains,  A|=Aj  =0-5 
Curve  3:  Doubled  gains,  2 

Command  signal  step  amplitude  20  V. 


is  seen  that  the  decrease  in  the  1 1 -element  of 
the  matrix  Nw  effects  a  decrease  of  the  sensi¬ 
tivity  of  the  output  z,  in  agreement  with  the 
argument  at  the  end  of  section  4. 

*  The  author  is  greatly  indebted  to  Mr.  R.  C.  W.  Strijbos 
for  writing  and  improving  the  programs  which  were 
developed  for  computing  the  optimal  filters. 


7.  CONCLUSIONS 

The  results  of  this  paper  show  that  for  linear 
time-invariant  systems  a  feedback  filter  may  be 
found  which  renders  the  closed-loop  system  in¬ 
sensitive  to  parameter  variations  in  the  sense  of 
Cruz-Perkins.  This  feedback  filter  follows  from  the 
stochastic  linear  regulator  theory  when  the  matrix 
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weighting  the  input  in  the  criterion  is  chosen  to 
be  the  zero  matrix.  The  weighting  matrix  in 
the  Cruz-Perkins  sensitivity  criterion  is  then  the 
inverse  of  the  covariance  matrix  of  the  measurement 
noise,  which  is  not  surprising. 

These  results  are  valid  under  certain  assumptions, 
of  which  the  most  important  seem  to  be  that  the 
controlled  output  is  included  in  the  observed  output 
and  that  the  system  is  minimum-phase. 

The  feedback  filter  which  makes  the  closed-loop 
system  insensitive  often  turns  out  to  be  violently 
differentiating  and  therefore  unrealizable.  Extra 
poles  may  be  introduced  by  choosing  the  weighting 
matrix  weighting  the  input  in  the  quadratic  criterion 
non-zero,  but  small.  This  will  cause  the  sensitivity 
reduction  condition  to  be  violated  over  a  certain 
frequency  range.  Often  this  will  not  greatly  affect 
the  system  performance.  The  asymptotic  theory 
presented  in  this  paper  may  be  very  helpful  in 
establishing  the  theoretical  limit  of  the  sensitivity 
reduction  that  may  be  achieved. 

The  analysis  shows  that  improvement  of  the 
sensitivity  properties  may  be  obtained.  The  more 
difficult  question  how  to  satisfy  prescribed  design 
specifications  has  not  yet  been  solved. 
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APPLNDIX  A 

Stability  of  the  control  system 

If  a  system  is  completely  conti ollable  any  initial 
slate  can  be  reached  instantaneously  by  the  applic¬ 
ation  of  a  suitable  linear  combination  of  derivatives 
of  delta  functions  ([13],  Ch.  11).  Condition  (vi)  of 
section  3  therefore  implies  that  one  may  write 

V0(s)=-G(s)ql(s)+H(s)q2(s)  (A.l) 

where  qfs)  and  q2(s)  are  suitable  vector  poly¬ 
nomials  in  s.  By  repeatedly  using  the  matrix 
identity  [14] 

{l  +  ABr^l-AU  +  BAY'B  (A. 2) 

the  lollowing  expressions  for  the  various  transfer 
matrices  occurring  in  (17)  and  (18)  [after  substitu¬ 
tion  of  (A.l)]  are  obtained 

(/  +  G<»)-l//  =  [f)(s/-^r1B]-1  (A. 3) 

(/  +  GO)" 1  GY  =  [D(s/  -  /*)' 1 B]  " 1 

D(sI-A  +  PC'N-iCyi 
PCN~lC(sI—A)~l  (A.4) 

(/  +  GO)' 1 G  =  [D(s/-  A)~  lBY  1 

D(sl  -  A+PC'N- lCT  lPC'N- 1 

(A.5) 

0,(7+  G4>)~lH=I  (A.6) 

T  ,-<!>,(/+ GO)” 1 GT- =  D(s/ -  A  +  PC'N; 1 C)  “ 1 

(A.7) 


0,(/+GO)_,G  = 

Disl-A  +  PC'N^Q-'PC'N;1  (A.8) 

Conditions  (ii)  and  (iii)  of  section  3  imply  that 
(sl  —  A  +  PC'N~iC)~l  is  stable  [2].  This  together 
with  condition  (i)  and  (iv)  implies  that  all  of  the 
listed  transfer  matrices  are  stable. 

Thus  it  has  been  shown  that  u  and  z  have  a 
stable  response.  Since  by  assumptions  (v)  and  (vi) 
the  syslctn  and  the  filters  are  completely  observable 
also  their  states  have  a  stable  response. 


... — . 
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APPENDIX  B 

Derivation  of  the  sensitivity  matrix  and  the  sensitivity 
relation 

After  substitution  of <P,(r),  <l>2(s),  Gfs)  and  G2(s) 
into  (35)  one  finds  after  some  manipulations  with 
the  aid  of  (A.2) 

S(s)  =  I—D(sI—A  +  PC'N~  ‘C)_l PD'N~tl .  (B.  1 ) 

As  a  result  of  the  partitioning  of  C  and  Mw  one 
can  write 

C'N-iC  =  D  N-llD+M'N-^M .  (B.2) 

Using  this  again  (A.2)  can  be  invoked  to  show 

S(s)  =  [/  +  D(s/  —  A  +  PM'N~21  M)~  'PD'N -,l] '  * . 

(B.3) 

The  asymptotic  variance  matrix  P  satisfies  the 
equation 

0=  —PC'N~iCP+AP+PA'  +  Nu.  (B.4) 

One  can  employ  (B.2)  and  add  and  subtract  some 
extra  terms  to  find  after  recording 

0=  -(sI-A+PM'N^M)P 

-Pi-sI-A'  +  M'N’iMF) 

+  PM’N-iMP-PD'N-l>DP+Nv.  (B.5) 

Premultiplication  by  D^sI-A  +  PM'N'iM)'1, 
postmultiplication  by  ( -  si  -  A'  +  M’N~2MP)~ 1 D' 
and  further  reordering  result  in  the  equality 

[/+ D(s/ -A  +  PM'NZ}M)~'PD'N ;,*] 

N*t[I+N~iDP(—sI  —  A'  +  M'N~2MPylD'] 

=N„i+D(sl-A+PM'N;lM)-' 

(Nv+PM'N;}MP)( -sl-A'  +  M'N~2  MPy 1 D' . 

(B.6) 

The  left-hand  side  of  this  expression  can  be  recog¬ 
nized  to  be 

(B.7) 


If  s  is  replaced  by  j2ttf,  the  right-hand  side  of  (B.6) 
is  the  sum  of  /Vwl  and  a  nonnegative-definite  matrix 
so  that 

S(j2nfyl  Nwl(S{-j2nfrlZNwt  for  all/.  (B.8) 

From  this  it  may  be  shown,  by  simultaneous 
reduction  to  diagonal  form,  that  (37)  holds. 


Resume — L’article  etudie  le  probleme  du  regulate ur  et  du 
servomecanisme  lineaire  stochastique  pour  des  systfemes  a 
variables  multiples  invariants  dans  le  temps.  II  est  montri 
que  dans  le  cas-limite,  lorsque  la  matrice  ponderant  I’entrie 
dans  le  critere  quadratique  est  la  matrice  z6ro,  le  systime  en 
boucle  ferme  est  insensible  aux  variations  des  paramitres  dans 
le  sens  le  Cruz-Perkins,  &  condition  que  la  systdme  &  regler 
sort  a  dephasage  minimale.  La  matrice  de  ponddration  dans 
le  critere  de  sensibility  de  Cruz-Perkins  s’avire  comme  ytant 
1‘inverse  de  la  matrice  de  covariance  du  bruit  de  mesure.  Un 
cxemple  simple  illustre  la  diminution  de  sensibility  obtenue 
avec  un  svstyme  it  deux  entryes  et  deux  sorties. 

lusammenfassung—  In  der  Arbeit  wird  der  stochastische 
Regler  und  das  Folge-Problem  fur  mehrvariable  zeitin- 
variante  Systeme  betrachtet.  Gezeigt  wird,  daO  in  dem 
Cjrenzfall,  wo  die  Matrix,  die  den  Eingang  in  dem  quadra- 
tischen  Kriterium  wertet,  die  Nullmatrix  ist,  das  geschlossenc 
System  in  Sinne  von  Cruz-Perkins  unempfindlich  ist  fur 
Parametervariationen,  vorausgesetzt,  daB  das  geregelte 
System  minimalphasig  ist.  Die  Gewichtsmatrix  in  Empfind- 
lichkeitskriterium  von  Cruz-Perkins  ist  dann  invers  zur 
Kovarianzmatrix  des  MeBrauschens.  Ein  einfaches  Beispiel 
illustriert  die  Abnahme  der  Empfindlichkeit  fur  ein  System 
■nit  zwei  Eingangen  und  zwei  AusgSngen. 

PeiioMe— CTaTbx  paccMaTpHBaeT  npoCnesty  Jimettnoro 
croxacTHMecxoro  peryjtaTopa  h  cepBOMexaxmMa  anx 
ItHBapHaHTHbIX  no  apeMCHH  MHOrOKOOpAHHaTHUX  CHCTCM . 
ItoKasbiBaeTca  sro  a  npeaejtbHOM  caytae,  xoraa  aecoBOtt 
MaTpHuett  axona  b  k Baapar hmcckom  kphtcphh  XBaxeTcx 
uyjicBaJi  MaTpuua,  CHCTCMa  b  vaMKHyTOM  KOHType  hcmvb- 
CTBtiTeJtbHa  k  himchchhxm  napaMeTpoB  b  CMUCJie  Kpyaa- 
HepxHHca,  npH  ycnoBHH  hto  ynpaajuKMaa  cncreMa  hmcct 
MHHHManbHo-ijiasoBbitt  xapairrep.  Becosax  MaTpmia  b 
xpHTepHM  MVDCTBMTeJibHOCTH  Kpy  va-tlepxHHfa  oxasbi- 
ttacTca  oOpamoit  xoBapMairrHofl  MaTpxue  HSMcpHTeabHoro 
uiyMa.  ripocTo#  npHMep  HamocrpupyeT  y Mettvincn He 
MyBCTBHicJibHocTH  nonyteHHoe  c  chctcmoR  o6naaatoiuefl 
a bv  m x  BxonaMH  h  anyMx  BbixoaaMH. 
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I.  Introduction 


The  trouble  with  observers  is  that  they  tempt  us,  through  the  expedient  of 
state  reconstruction,  to  assign  undue  generality  to  control  results  proven 
only  for  the  full-state  feedback  case.  An  example  is  the  recent  robustness 
result  of  Safonov  and  Athans  This  result  shows  that  multivarjable 

linear-quadratic  optimal  regulators  have  impressive  robustness  properties, 
including  guaranteed  classical  gain  margins  of  -6  db  to  +  •  db  and  phase 
margins  of  +  60  deg.  in  all  channels.  The  result  is  only  valid,  however, 
for  the  full  state  case.  If  observers  or  Kalman  filters  are  used  in  the 
implementation,  no  guaranteed  robustness  properties  hold.  In  fact, 
a  simple  example  has  shown  that  legitimate  LQ6  controller-filter 
combinations  exist  with  arbitrarily  small  gain  margins  in  both  the  positive 
and  negative  db  direction  [2!. 

W  w 

In  light  of  these  observations,  the  robustness  properties  of  control  systems 
with  filters  or  observers  need  to  be  separately  evaluated  for  each  design. 
Moreover,  because  such  evaluations  can  come  up  with  embarassingly  small 

t 

margins,  a  "design  adjustment  procedure"  to  improve  robustness  would  be  very 

desirable.  The  present  paper  provides  such  a  procedure.  We  show  that  while 

the  commonly  suggested  approach  of  "speeding-up"  observer  dynamics  will  not 

work  in  general,  alternate  procedures  which  drive  some  observer  poles 

toward  stable  plant  zeros  and  the  rest  toward  infinity  do  achieve  the  desired 

objective.  In  effect,  full-state  robustness  properties  can  be  recovered 

asymptotically  if  the  plant  is  minimum  phase.  This  occurs  at  the  expense  of 
noise  performance. 


The  principal  results  of  the  paper  are  summarized  in  Section  II,  where  we 
introduce  and  interpret  certain  transfer  function  properties  of  observer- 
based  control  systems,  and  in  Section  III,  where  we  develop  the  "adjustment 
procedure".  A  simple  example  which  illustrates  these  results  is  given  in 
Section  IV. 
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The  plant  is  an  n-th  order  linear  system,  both  observable  and  controllable, 
with  m  inputs,  p=m  outputs,  and  no  transmission  zeros  in  the  right  half 
plane.  The  control  law  consists  of  two  transfer  function  matrices  ^  (s)  id 
H^ts).  Hg  is  driven  either  with  full-state  feedback  (Fig.  1A)  or  with  an 
n-th  order  "model -reference  observer"  [4J  which  reconstructs  the  state  in  the 
usual  asymptotic  sense  (Fig.  IB).  It  is  clear  that  this  overall  control  loop 
includes  linear-quadratic-gaussian  controllers  as  special  cases.  It  also 
allows  dynamic  elements  such  as  integrators  and  lag  elements  which  may  be 
required  in  more  realistic  control  situations. 


This  configuration  also  applies  to  nonsquare  plants  for  which  the  number  of 
controls,  m,  is  not  equal  to  the  number  of  measurements,  p.  For  the  case, 
m<p,  simply  augment  the  original  control  vector  with  (p-m)  more  components 
which  are  not  driven  by  the  controllers  (i.e.^Hj  *  Hjjioj).  Columns  of 
the  B  matrix  for  these  added  components  must,  of  course-,  be  selected  to  Intro¬ 
duce  no  unstable  transmission  zeros. 


For  the  case,  m>p,  select  any  p-  dimensional  subset  of  controls  for  which 
there  are  no  right  half  plane  transmission  zeros.  Then  the  loop  transfer 
properties  which  are  established  in  this  paper  apply  to  this  p-dlmensional 
subset  of  control  loops,  with  the  remaining  (m-p)  loops  closed. 

A  dashed  line  Is  shown  In  both  Figure  1A  and  IB  In  order  to  distinguish 
between  elements  of  the  loop  which  are  part  of  the  controller  and  those 
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which  are  part  of  the  plant.  Since  we  design  and  implement  the  controller, 
there  is  relatively  little  uncertainty  associated  with  it,  whereas  there  may 
be  significant  differences  between  the  actual  plant  and  its  model.  The  loop 
transfer  functions  which  we  examine  for  robustness, below,  are  then  taken  with 
respect  to  the  loop  breaking  point,  X,  at  the  control  signal  interface  be  ween 
these  two  sets  of  elements.  Very  misleading  robustness  results  can  be  ob¬ 
tained  for  alternate  loop  breaking  points,  for  example  point  XX.  This  is 
also  shown  below. 

The  following  properties  can  be  established  for  the  above  two  control  loop 
Implementations: 

Property  1 

The  closed  loop  transfer  function  matrices  from  command  r  to 
state  x  are  Identical  in  both  Implementations. 

Property  2 

The  loop  transfer  function  matrices  from  control  signal 
u'  to  control  signal  u  (loops  broken  at  point  XX)  are 
Identical  in  both  implementations 

Property  3 

The  loop  transfer  function  matrices  from  control  signal 
u"  to  control  signal  u*  (loops  broken  at  point  X)  are 
generally  different  in  the  two  implementations  even  when 
the  observer's  error  dynamics  are  allowed  to  be  arbitrarily 
fast. 


■  •  wr-’  -  --AM 


-5- 


• _ 


- - - - 


Property  4 

The  loop  transfer  function  matrices  from  u"  to  u’  are 
identical  in  both  implementations  if  the  observer 
dynamics  satisfy 

K  [  I  +  C  (sI-A)"1k]  "1  =  B  [C(sl-A)“1B  ]  -1  (1) 

for  all  values  of  the  complex  variable  s.  The  A,  B, 
and  C's  above  are  plant  matrices  and  K  is  the  observer 
gain. 

The  first  two  of  these  properties  are  very  well  known  [5,6j.  They  can  be 
easily  verified  by  noting  that  the  transfer  functions  from  u'  to  x  and  from 
u*  to  x  are  identical  because  the  nominal  error  dynamics  of  the  observer  are 
not  controllable  from  u'.  These  two  properties  are  also  the  source  of  much 
of  the  temptation  surrounding  observers,  however.  We  see  that  input/output 
properties  are  the  same  and  even  certain  loop  transfer  functions  are  the 
same.  The  latter  promise  equal  relative  stability  properties,  equal  toler¬ 
ance  to  uncertainties  (robustness),  and  equal  disturbance  rejection  properties. 
What  more  could  we  ask  for? 


The  problem,  of  course,  is  that  the  loop  transfer  properties  are  the  same 
at  Point  XX,  Inside  our  own  control  implementation  where  only  masochists 
would  Insert  significant  uncertain  elements  or  disturbances.  According  to 
Property  3,  equal  loop  transfer  characteristics  are  not  obtained  at  the 
control  signal  Interface  to  the  plant,  Point  X,  where  Nature  gets  to  Insert 
uncertainties  and  disturbances.  It  is  at  this  point  that  robustness  prop¬ 
erties  must  be  measured,  and,  as  seen  in  M,  it  Is  here  that  observer- 
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based  implementations  can  fall  well  short  of  our  objectives. 


Property  3  will  be  verified  by  means  of  example  later.  We  now  turn  instead 
to  the  more  interesting  Property  4.  This  result  is  apparently  not  as  well 
known,  so  a  simple  derivation  is  given  in  Appendix  A.  It  is  important  be¬ 
cause  it  offers  a  way  to  adjust  observers  so  that  full -state  loop  transfer 
characteristics  are  recovered  at  Point  X.  In  particular,  suppose  the  observer 
gains  are  parameterized  as  a  function  of  a  scalar  variable  q.  Let  this 
function,  K(q),  be  selected  such  that  as  q  -*■  » 

K(q)  -  q  BW  (2) 

for  any  nonsingular  matrix  W.  Then  equation  (1)  will  be  satisfied  asymtot- 
Ically  as  q  ■*■  «.  The  resulting  observer  error  dynamics  will  have  limiting 
poles  given  by  roots  of  the  polynomial 

x(s)  *  det(sI-A)det  [i  +  qC(sI-A)-1BW  j  ,  ^ 

P  of  these  roots  will  tend  toward  the  P  finite  transmission  zeros  of  the 
plant  (stable  by  assumption)  and  the  rest  will  tend  to  infinity.  It  Is 
clear  from  this  that  the  commonly  suggested  approach  of  making  all  roots  of 
the  error  dynamics  arbitrarily  faster  is  generally  the  wrong  thing  to  do. 


Ill .  An  Observer-Adjustment  Procedure 

Equation  (2)  defines  the  required  limiting  characteristics  of  an  adjustment 
trajectory,  K(q),  which  changes  arbitrary  initial  nominal  observer  gains, 

K(o),  with  poor  robustness  properties  into  better  gains  asymptotically.  We 
still  need  to  define  details  of  such  trajectories. 

A  basic  requirement  for  every  point  of  an  adjustment  trajectory  is  stabil¬ 
ity  of  the  observer  error  dynamics.  Clearly,  if  we  violate  this  require¬ 
ment,  overall  closed  loop  stability  is  also  lost.  (Note  that  this  does 
not  mean  that  the  net  compensator  within  the  dashed  lines  of  Figure  IB 
needs  to  be  stable.)  One  way  to  assure  stable  error  dynamics  is  to 
restrict  the  observer  to  be  a  Kalman  filter  for  some  set  of  noise  param¬ 
eters.  That  is,  let 

K(q)  =  E(q)  CT  R-1  (4) 

with  l(q)  defined  by  the  Riccati  equation 

Al  +  iAT  +  Q(q)  -  icV^I  =  0  (5) 

As  usual  we  take  Q  *  QT  >,o  and  R  -  RT  >o.  For  Kalman  filters,  these 

'  .  i 

matrices  represent  given  process  noise  and  measurement  noise  Intensities, 
respectively.  Here  they  are  treated  more  freely  as  design  parameters 
which  we  can  select  to  suit  broader  purposes.  In  particular,  let 


Q(q)  c  Qo  +  q2BVBT 

(6) 

R  «  R 

0 

(7) 

where  Qo  and  Rq  are  noise  Intensities  appropriate  for  the  nominal  plant, 
and  V  Is  any  positive  definite  symmetric  matrix.  With  these  selections. 
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the  observer  gain  for  q  =  o  corresponds  to  the  nominal  Kalman  filter  gain. 
However,  as  q  approaches  infinity,  the  gains  are  seen  from  (5)  to  satisfy. 


and 


K  R  KT 


q2  BVBT 


K  — >q  B  Vj  Rj1,  (8) 

where  Vj  denotes  some  square  root  of  V  (VjVj  *  V)  and,  similarly,  Rj  is 
some  square  root  of  R.  Since  (8)  is  a  special  case  of  (2),  it  follows  that 
the  adjustment  procedure  defined  by  (4)- (7)  will  achieve  the  desired  robust¬ 
ness-improvement  objective. 


Note  that  the  second  term  in  equation  (6)  can  be  interpreted  as  extra 
process  noise  added  directly  to  the  control  input  of  the  plant.  Within 
the  constraints  of  Kalman  filter  mathematics,  such  "fictitious  noise"  is 
a  natural  mechanism  to  represent  uncertainties  at  this  point  of  the 
control  loop.  It  is  nice  to  know  that  the  resulting  filter  design  act¬ 
ually  responds  with  a  corresponding  robustness  Improvement.  Note,  how¬ 
ever,  that  arbitrary  increases  of  the  existing  noise  matrix  (I.e., 

Q  *  (1  +  q‘)  Qq)  or  addition  of  arbitrary  full  rank  noise  process 
(I.e.,  Q  *  Qo+  q  W  with  W  »  W  >o)  which  are  often  suggested  as  other 
Intuitive  robustness  Improvement  methods,  will  not  in  general  produce 
the  desired  effect. 


Finally,  we  note  that  the  use  of  Kalman  filter  equations  in  the  adjust¬ 
ment  procedure  is  not  fundamental.  The  filters  merely  provide  a  conven¬ 
ient  way  to  assure  stability  along  the  entire  adjustment  trajectory. 

Any  other  procedure  (pole  placement,  for  example)  with  the  same  limiting 
properties  (2)  could  be  used  as  well. 
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IV.  An  Example 


To  illustrate  the  observer  properties  and  adjustment  procedure  above, 
consider  the  following  example: 


Plant: 


dx 

dt 


0  1] 


i  x  + 


i  -3  -4 


0l 

1  1 


u  + 


35 


L-61J 


i  * 


(9) 


y  -  [2 

with  E  U)  =  E  (n)  *  0; 


1  *•  x  +  n 

J 


[c(t)c(x)] 


(10) 

E  £n(t)n(x)  *  6 ( t-r ) 


Controller: 


u  *  !  -50 


-10  “J  x  +  [50]  r 


(ID 


The  plant  in  this  example  is  a  (harmless)  stable  system  with  transfer  function. 


s)  *  (s  +  l)(s2+  3) 

The  controller  happens  to  be  a  linear-quadratic  one,  corresponding  to  the 
performance  index 


(12) 


J  = 


with 


^ (xTHTHx  +  u2)  dt 


(13) 


H  «  4  \  5  |  V3T 

It  places  the  closed  loop  regulator  poles  at 

s  *  -7.0  ♦  J2.0 


‘J 
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A  Nyquist  diagram  (polar  plot  of  the  loop  transfer  function  at  Point  X)  for 
the  full-state  design  is  given  in  Figure  2.  Gain  margin  is  infinite  in  both 
directions  and  there  is  over  85°  phase  margin.  The  design  is  then  implemented 
using  a  Kalman  filter  for  the  given  noise  parameters.  The  Nyquist  plot  for 
the  resulting  observer-based  controller  is  also  shown  in  Figure  2.  Oops.  . 
less  than  15°  phase  margin. 

In  an  effort  to  improve  this  margin,  one  adjustment  to  the  filter  that  could 
be  made  is  to  speed  it  up.  So,  we  can  try  moving  the  filter/observer  poles 
to  the  left  in  a  second-order  Butterworth  pattern.  For  the  filter/observer 
poles  at  -22-17 . 86 j  one  gets  the  third  Nyquist  plot  in  Figure  2.  As  can 
be  seen,  the  results  are  less  than  satisfactory.  Not  only  are  the  margins 
disappearing  (now  less  than  10  degrees)  but  the  loop  bandwidth  has  Increased 
(crossover  has  gone  from  approximately  12.  to  40.  rad/sec). 

Unless  we're  trying  to  design  an  explosive  device,  this  Is  clearly  undesir¬ 
able.  It  gets  worse  as  the  filter  gets  faster.  In  fact,  it  can  be  shown 
that  the  margins  go  asymptotically  to  zero  for  large  gains,  while  the  loop 
bandwidth  goes  to  infinity.  The  present  example  is  not  a  pathological  one, 
either.  Similarly  undesirable  characteristics  for  fast  filters  are  obtained 
with  most  systems. 

When  the  observer  adjustment  procedure  of  Section  III  Is  applied  to  the 
same  example,  much  more  pleasing  behavior  is  obtained.  Following  (6) -(7),. 
we  let  the  process  noise  covariance  matrix  be 


We  then  increase  q  from  zero  until  a  reasonable  compromise  between  noise 
performance  and  robustness  is  achieved.  Some  results  of  this  process  arj 
summarized  in  Figure  3  and  Table  1.  Figure  3  shows  Nyquist  diagrams  for 
q  *  100,  500,  1000,  and  10,000.  Margins  improved  with  essentially  no 
change  in  bandwidth  as  the  modified  loop  transfer  function  tends  toward 
full  state  optimal.  Noise  performance  is  summarized  in  Table  1  for  the 
same  set  of  q  values.  As  expected,  the  error  covariance  of  the  adjusted 
filter  with  respect  to  the  original  noise  Increases  markedly  with  q. 

However,  there  was  not  the  same  deterioration  in  state  covariance. 

Table  1  also  documents  other  parameters  associated  with  these  design 
points  -  -  poles  of  the  error  dynamics,  margins,  and  filter  gains.  Note 
In  particular  that  the  filter  poles  tend  toward  the  plant  zero  and  toward 
Infinity,  as  required  by  (3). 

i 

This  adjustment  procedure  was  also  successfully  applied  to  reconstruction  of 
measured  outputs  after  sensor  failures  for  the  A7-D  aircraft.  ^  In 
this  application  the  optimum  Kalman  filter  produced  an  unstable  system 
when  tested  In  hybrid  simulation  over  the  A-7D  flight  envelope.  After 
attempts  with  "ad  hoc"  fictitious  noise  adjustment  procedures  failed  the 
method  discussed  here  successfully  stabilized  the  system.  Also,  the 
resulting  error  covariance  properties  remained  closed  to  the  optimum 
values. 
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This  paper  illustrates  some  of  the  difficulties  one  can  get  into  by  relying 
on  observers  for  state  reconstruction.  We  have  concentrated  on  robustness 
properties.  In  general,  these  will  be  poorer  for  observer-based  implemen¬ 
tations  than  for  full-state  implementations.  For  minimum-phase  systems, 
however,  full -state  robustness  can  be  recovered  asymptotically  provided  it 
is  done  correctly.  Fast  observers  are  not  in  general  correct.  A  "fictitious 
noise"  adjustment  procedure  was  suggested  which  is. 

The  apparent  practical  value  of  this  procedure  is  that  it  gives  a  simple 
way  of  trading  off  between  noise  rejection  and  margin  recovery.  When 
q  *  0,  the  filter  will  be  optimal  with  respect  to  the  "true"  (as  modelled) 
system  noise.  As  q  increases  the  filter  will  do  a  poorer  job  of  noise 
rejection  but  the  closed-loop  stability  margins  will  Improve.  Hopefully, 
a  satisfactory  compromise  can  be  found  through  the  adjustment  of  the  single 
parameter  q.  Ue  stress  that  margin  recovery  occurs  at  Point  X  in  Figure  1 
—  at  the  control  signal  interface  to  the  outside  world.  Asymptotically, 
the  full-state  and  observer-based  implementations  will  have  the  same  tol¬ 
erance  to  disturbances  and  uncertain  elements  Inserted  at  this  point.  While 
Point  X  Is  clearly  a  physically  Important  one  (more  Important  than  Point  XX, 
certainly),  engineers  who  may  wish  to  test  robustness  at  still  other  points 
in  the  control  loop  should  recognize  that  the  recovery  results  may  not  be 
applicable  there. 

The  suggested  adjustment  procedure  Is  essentially  the  dual  of  a  sensitivity 
recovery  method  suggested  by  Kwakenaak  [7].  The  latter  provides  a  method 


for  selecting  the  weights  in  the  quadratic  performance  index  so  that  full- 
state  sensitivity  properties  are  achieved  asymptotically  as  the  control 
weight  goes  to  zero.  In  this  case,  however,  closed  loop  plant  poles  instead 
of  observer  poles  are  driven  to  the  system  zeros,  which  can  result  in  unac¬ 
ceptable  closed  loop  transfer  function  matrices  for  the  final  system. 


acknowledgements 


We  would  like  to  thank  the  Math  Lab  Group,  Laboratory  for  Computer  Sciences, 
MIT  for  use  of  their  invaluable  tool,  MACSYMA,  a  large  symbolic  manipulation 
language.  The  Math  Lab  Group  is  supported  by  NASA  under  grant  NSG  1323  and 
DOE  under  contract  #E( 1 1-1 ) -3070. 


optimal 

FILTER 


Figure 


APPENDIX  A:  Derivation  of  Property  4 


Referring  to  Figure  1A,  the  loop  transfer  function  from  u"  to  u*  of  the  full 
state  implementation  is  obtained  from  the  relationships 


x  *  4>(Bu"  +  Fv) 
u'  =  -H^x  , 

where 

♦  *  (sI-A)1 
v  *  — G^G£X  . 


(A.l) 

(A.2) 

(A. 3) 
(A.4) 


The  variables  v  above  are  now  shown  in  Figure  1  for  the  sake  of  simplicity. 

They  denote  the  (m-p)  control  components  for  which  loops  are  not  broken 
In  the  event  that  p  <  m.  Matrices  F,  Gj.and  G2  are  to  control  Input  matrix 
and  the  feedback  compensator  matrices  for  these  components,  respectively. 

If  the  original  plant  is  square  or  can  be  made  square  by  augmenting  (p-m) 
additional  control  variables,  then  v,  F  Gj  and  G2  are  zero  identically.  For 
either  situation,  (A.l)  -  (A.4)  define  the  following  full-state  loop  trans- 

i 

few  function: 

u'  *  -HjH2  (I  +  ♦FG1G2)‘1  «Bu"  (A.5) 

The  corresponding  relationships  for  observer-based  implementations  are 
(Fig.  IB). 

x  «  U'1  +  KC)"1  (Bu'  ♦  Fv  +  KC*(Bu"  +  Fv)} 


(A. 6) 


*  (r1  +  KC)"1  {Bu'  +  KC«Bu"  +  (»_1  +  KC)  4>F v } 

=  U"1  +  KC)"1  {Bu1  +  KCiBu" }  +  $Fv 

with 

u'  =  -HjH2x 

v  *  -GjG2x  (A. 7) 

This  gives 

u'  *  -HjH2(I  +  ♦FGjGg)’1  ($_1  +  KC)"1  {Bu*  +  KC*Bu").  (A. 8) 

Now  applying  the  Matrix  inversion  lemma  to  the  ($  1  +  KC)  1  term  in  this 
expression  gives 

u'  *  -HjHjO  +  *FG1G2)"1  *  *-*K(I  +  C*K)_1C*]  (Bu*  +  KC*Bu") 

*  -HjHgd  +  *FG1G2)'1  o  [ B-K( I  +  C*K)_1C«b]  u' 

-HjH2(I  +  ♦FGjGg)"1  «K  (I  +  CGK)"1  C*B  u".  *  (A.9) 

From  (A.9)  It  follows  that  If  (1)  is  satisfied,  then  the  u*  term  on  the 
right  hand  side  vanishes  and  the  u"  term  is  identical  to  (A. 5).  Since  u" 

Is  arbitrary,  this  establishes  the  claimed  equality  of  loop  transfer  functions. 
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Abstract 


State  feedback  regulators  are  derived  which  have  better  robustness 
characteristics  than  the  standard  60°  phase  margin  and  50%  gain  reduction 
tolerance  of  standard  linear-  quadratic  regulators.  It  is  also  shown  how 
the  Lyapunov  equation  can  be  used  to  design  high- integrity  regulators  for 
open-loop  stable  systems. 
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1 .  Introduction 

Any  practical  control  system  synthesis  is  subject  to  uncertainty.  This 
uncertainty  may  appeal  as  non-measurable  disturbances  on  the  input,  or  only 
partly  known  or  time  varying  system  parameters , to  quote  a  few  examples.  The 
topic  of  the  present  paper  is  to  study  one  example  of  such  parameter  un¬ 
certainty,  namely  large  variations  in  the  input  channels. 

The  criterion  chosen  for  our  "acceptable"  closed-loop  system  behavior 
is  stability.  This  is,  of  course,  far  from  sufficient  for  practical  purposes, 
but  such  analysis  may  all  the  same  produce  some  guidelines  for  the  design  of 
practical  control  sytems.  The  step  from  a  qualitative  to  a  quantitative  result 
is  often  a  short  one. 

Since  the  discovery  by  Kalman  [1]  of  the  frequency  domain  inequality 
satisfied  by  linear-quadratic  optimal  regulators,  a  great  deal  of  literature 
has  been  produced  on  the  "robustness"  of  such  regulators.  In  terms  of  classical 
control  concepts,  Kalman's  inequality  implies  that  they  possess  60°  phase 
margin,  infinite  gain  margin,  and  50%  gain  reduction  tolerance.  This  result 
holds  under  the  only  assumption  that  the  penalty  matrix  of  the  state  variable 
in  the  performance  index  is  positive  semidefinitive. 

Although  60°  phase  margin  seems  a  lot,  it  may  be  insufficient  in  certain 
cases.  Dynamics  of  the  actuators  x+c  and  time  delays  may  have  been  neglected  in 
the  model,  for  instance.  Thus  it  is  of  interest  to  synthesize  regulators  with 
improved  robustness  characteristics. 

As  is  easy  to  see  from  examples,  the  above  results  cannot  be  strengthened 
without  further  assumptions  on  the  performance  index  or  the  plant.  Assumptions 
used  here  are  decreasing  penalty  on  the  control  variables  (  cheap  control) 
and  stability  of  the  open  loop  system,  respectively. 


» 


> 


2 .  Formulation  of  the  Problem. 

Consider  the  linear  time  invariant  system  described  by 
x(t)  =  Ax (t)  +  Bu (t) 

x (0)  =  x  .  (1) 

o 

x(t)  and  u(t)  are  n-  and  p-vectors,  respectively.  Assume  that  the  desired  input 

is  given  by  the  linear,  constant  state  feedback 

u ( t )  =  -  LTx(t)  (2) 

but  that  the  implementation  is  computed  by  some  time  varying  nonlinearity 

<J>(*,t),  i.e.  the  actual  input  u(t)  is  given  by 

u  (t)  =  -  <J)(LTx  (t)  ,t)  (2)'. 

P  P 

Here,  • , t )  is  a  nonlinear  function  from  R  to  R  for  each  t,  subject  to 
the  condition 

K1aTo  <_  oT<J>  (a  ,t)  <_  k2oto  VGe  RP  (3). 

The  problem  is  to  guarantee  global  asymptotic  stability  of  the  null  solution 
of  (1),  (2)’  subject  to  (3)  for  given  K. ,  K2- 

Although  the  problem  is  formulated  for  the  case  of  a  memoryless  non¬ 
linearity  4>(*,t),  the  results  can  easilty  be  generalized  to  dynamic  disturbances 
using  modern  frequency  domain  stability  theorems  (see  e.g.  [2]).  This  has  been 
exploited  in  [3],  but  will  not  be  pursued  here. 
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For  notational  simplicity,  R  =  I  will  be  assumed  in  the  sequel. 

Standard  manipulations  of  equation  (5) lead  to  the  frequency  domain 
equality 

(I  +  GT(-ito) )  lp(I  +  G (ioo) )  =  Ip  +  BT(-iw  -  aV1  Q  ( ico  -  A)_1B  (6), 

where 

G(s)  =  R-1BTP(sI  -  A)_1B. 

An  alternative  form  of  (6)  for  the  closed-loop  system  is,  with  G(s)  =  G(s)(I+G(s)) 
(I  -  GT(-i(i)))I  (I  -  G(iCd))  =  I  -  BT(-iO)  -  aV1  Q(iu  -  A)_1B  (6)'. 

r  r 

If  Q  is  positive  semidefinite ,  the  second  term  on  the  right-hand  side  is 
nonnegative,  and  the  following  inequality  results: 

(I  -  GT(-iw))I  (I  -  G ( xco) )  £  I  (7). 

r  r 

A  straight-forward  application  of  the  circle  criterion  then  implies  the  desired 
stability  for 

=  ~,  K2  =  any  finite  K. 

It  is  obvious  that  the  best  possible  lower  bound  without  restrictions  on  the 
plant  is 


\  >  0  (8). 

For  certain  high-gain  regulators,  (8)  is  in  fact  sufficient  as  will  now  be 
shown.  Consider  the  performance  index  Jp,  where  the  penalty  on  the  input  is 
modified  via  the  scalar  variable  p: 

Jl  OO 

(x(t)T  Qx(t)  +  pu(t)T  u(t) )dt. 
o 

Choosing  p  small  means  that  very  large  control  signals  are  permitted.  It 
seems  reasonable  to  conjecture  that  such  a  design  should  yield  a  controller 
with  high  integrity.  This  is  indeed  the  case. 

Theorem  1.  Consider  the  control  system  (1),  (2),  with  4>(*,t)  subject  to  (3). 
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For  any  >0  and  any  <  00  there  is  a  2  i  0  such  that  the  optimal  controller 
relative  to  Jp  quaruntees  asymptotic  stability  in  the  large  of  the  null  solution 
for  all  p  >0  sufficiently  small. 

Proof :  The  Riccati  equation  pertaining  to  Jp  is 

ATPp  +  PpA  +  Q  -  P_1PpB  BTPp  =0  (5) ' . 

Two  reductions  of  the  general  case  will  be  made.  Firstly,  it  may  assumed  without 
loss  of  generality  that 

rank  (Q)  rank  (B)  =  p, 

T 

(see  [4]).  Thus  Q  can  be  factored  as  MM  ,  with 
rank  (M)  £  rank  (B) . 

There  are  several  M-matrices  that  generate  the  same  feedback  matrix, 

corresponding  to  various  factorizations  of 

T  T  -1  -It  T  -1  T  -1 

B  (-si  -  A  )  Q(sl  -  A)  B  =  B  (-SI  -  A  )  MM  (si  -  A)  B. 

If  the  M  that  makes 

M(s)  =  MT(sI  -  A)-1  B 

minimum  phase  is  chosen,  the  conditions  are  satisfied  which  ensure  that  (15], 

[6]) 

lim  P  =  0 
f>+o  P 

Equivalently, 

lim  p_1P  B  BT  P  =  Q  =  MMT  (9). 

P"K>  V  ^ 

Starting  from  Riccati  equation  (5) '  and  using  the  same  manipulations  that 
lead  to  inequality  (6)'  then  shows,  inserting  (9),  that 

G  (s)  =  p_1BTpp(sI  -  A  +  P_1BBTPp)"1  B 
satisfies 

<jl  -  GpT(-s))Ip(il  -  Gp(s))  <lp  +  0(p-1),  p  +  0. 

This  proves  the  claim. 

Remark:  A  weaker  version  of  Theorem  1,  corresponding  to  a  4>(*,t)  that  is 


— -  ■  • 
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diagonal  (i.e.  no  cross-couplings  between  the  inputs),  can  be  proved  using  the 
results  of  [7]. 

In  classical  terminology ,  this  regulator  possesses  a  phase  margin  arbitrary 
close  to  90°,  infinite  gain  margin,  and  a  gain  reduction  tolerance  arbitrarily 
close  to  100%. 

There  is  an  alternative  way  of  generating  such  controllers,  which  is 
almost  trivial.  The  proof  is  Left  to  the  reader. 

Theorem  2.  Consider  (1),  (2)'  with  <t>(*,t)  subject  to  (3).  If  I,  is  chosen  as 

L  =  £_1  L  , 
o 

where  Lq  is  any  optimal  gain  generated  from  a  positive  semidefinite  Q,  then 
the  controller  enjoys  the  same  robustness  properties  when  £+0  as  the  controller 
of  Theorem  1  when  p  ->  0. 

Theorems  1  and  2  must  be  used  with  some  caution,  since  in  applications  the 
sector  bounds  and  K2  may  depend  on  the  nominal  feedback  gain  L.  An  example  is 
given  in  Section  5. 


Results  for  Open-Loop  Stable  Plank 


If  the  plant  is  open-loop  stable,  it  should  be  possible  to  design  controllers 


where  the  lower  bound  is  zero.  A  complete  characterization  of  such  feedback 
matrices  L  is  given  in  the  following  theorem. 


Theorem  3.  The  feedback  system  (1),  (2)'  with  <j)(*,t)  satisfying  (3)  has  a 
globally  asymptotically  stable  equilibrium  solution  for 
^  =  0,  K2  =  any  K>  0 

T 

if  there  exist  matrices  K  =  K  >0  and  C,  (C,A)  being  an  observable  pair,  such 
that 

/  T  T 

A  K  +  KA  =  -CC 


KB  =  L. 


(10) 
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Proof :  This  is  a  straight-forward  application  of  the  Kalman  Yakubovich- 

Popov  lemma  in  its  multivariable  form  ([8]).  Equation  (10)  provides  a  means 
to  design  high- integrity  controllers,  namely  by  solving  the  (linear)  Lyapunov 
equation  for  K  and  then  choosing  the  feedback  gain  L  as  (any  positive  multiple  of) 
KB.  There  remains  the  problem  of  choosing  C  and  a  positive  gain,  but  this 
problem  is  shared  by  the  LQOC  methodology.  For  single-input  systems,  equation  (10) 
is  simplified  further  if  it  is  translated  into  the  frequency  domain.  Defining 
p(s)  as  the  open- loop  characteristic  polynomial  and 


T  -1 

L  (si  -  A) 


B 


r(s)  r(-s) 
p(s)  p  (— s) 


T  T  -1 

=  B  (-si  -  A  ) 


yields  the  equation 


p (s)  q(-s)  +  q(s)  p (— s)  =  r(s)  r(-s)  (10)'  . 

This  can  be  solved  for  q(s),  which  is  turn  gives  the  unique  feedback  gain  L. 

The  condition  of  Theorem  3  is  rather  strong.  In  general  an  infinite 
gain  margin  is  not  required.  The  following  theorem  characterizes  the  feed¬ 
back  gains  that  retain  stability  for  all  gain  drops. 


Theorem  4.  The  claim  of  Theorem  3  remains  valid  for 
K!  "  0'  *2  =  1 

T 

if  there  exist  matrices  K  *  K  >  0,  C,  and  D,  and  an  £  >  0  such  that 

T  T  T 

A  K  +  KA  =  -  CC  -  DD 

(11) 

KB  =  1  -  (/2  -  e)D 


I  t 

)  j 
i  \ 


Proof.  This  is  again  a  direct  application  of  the  circle  criterion  in  combination 
with  the  Kalman-Yakubovich-Popov  lemma.  Compared  to  equation  (10) ,  the  use  of 
equation  (11)  involves  the  extra  problem  of  choosing  D.  Theorem  4  can  of  course 

I 

I 

I 
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be  generalized  to  any  upper  and  lower  bounds  K.^  and  (provided  the  system 
is  open  loop  asymptotically  stable  if  £  0  <_  K2> 

5.  Discussion  of  the  Results 

The  results  presented  above  must  be  interpreted  with  some  caution.  It  is 
quite  clear  that  most  actuator  failures  are  such  that  no  judicious  choice  of 
feedback  gains  can  save  the  situation.  This  is  even  more  true  for  the  case 
of  sensor  failures  (not  treated  here) .  Thus  in  general  one  will  have  to  rely 
on  external  failure-handling  routines. 

The  sharpening  of  previous  results  for  arbitrary  plants  relies  upon 
the  use  of  high  gains.  This  must  be  kept  in  mind  if  the  nominal  input  influences 
the  sector  of  <J>(»,t).  For  instance,  if  the  gain  drop  of  the  regulator  is  caused 
by  saturation,  there  is  obviously  no  point  in  increasing  the  nominal  gain. 

With  these  reservations  kept  in  mind,  the  theorems  yet  contribute  to 
the  general  robustness  picture  of  state  feedback  regulators.  Theorem  3  is 
believed  to  yield  a  practicable  design  method  for  control  systems  where  the 
input  channel  uncertainty  is  so  great  that  it  has  to  be  accounted  for  in  the 
synthesis. 


I 

■ 


.  j;- . . 
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ABSTRACT 


For  systems  that  are  open-loop  stable,  there  is  a  class  of  feedback  controllers 

that  have  the  property  that  the  closed  loop  system  is  stable  and  remains  stable  1 

in  case  actuator  outages  occur.  Properties  of  a  special  subclass  of  these 

controllers  are  discussed. 


This  work  was  supported  by  the  Department  of  Energy  under  Contract 
ET-78-C-01-3391.  The  work  was  motivated  by  discussions  with  Mr.  J.C.  Doyle 
concerning  the  Integrity  property  of  controllers  that  have  gains  which  are 
determined  from  Liapunov  rather  than  Rlccati  equations. 


- - . »  _ _ . _ 


INTRODUCTION:  Consider  the  linear  controllable  system 

x  *  Ax  +  Bu  (1) 

where  A  Is  stable,  l.e.,  the  eigenvalues  of  A  have  negative  real  parts.  The 
class  of  state  feedback  regulators  of  the  form 

u  =  -BTPx  (2) 

where  P  satisfies  the  Liapunov  equation 

PA  ♦  ATP  +  Q  -  0,  Q  >  0  (3) 

L 

with  (A,  q1)  observable  are  of  special  Interest  because  the  closed  loop 
systems  with  related  regulators  of  the  form 

u  »  -LBTPx,  L  »  LT  -  0 

are  stable.  Such  regulators  may  be  considered  to  possess  Integrity  with 
respect  to  loss  of  Imputs,  that  Is,  stability  of  the  closed  loop  system  is 
maintained  when  one  or  more  Inputs  Is  set  to  zero.  This  situation  of  loss  of 
Inputs  can  be  represented  by  an  admissible  L  In  (4).  For  example,  the  loss 
of  the  first  Input  may  be  represented  by  taking  L  to  be 


The  class  of  regulators  defined  by  (2)  and  (3)  Is  a  subset  of  the  class  of 
optimal  state  feedback  controllers.  This  fact  and  the  proof  of  the  stability 
for  regulators  of  the  form  (4)  are  given  below,  followed  by  other  results  aimed 
at  characterizing  the  class  of  regulators  of  Interest. 
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The  regulator  given 


by  (2)  and  (3)  Is  the  optimal  regulator  for  (1)  with  respect  to  the  performance 
Index 


J  *  f (xT(Q  +  PBBTP)x  +  uTu}dt  (6) 

Jo 

for  P  satisfying  (3)  and  A  being  stable,  P  >  0,  so  that  Q  +  PBBTP  >  0. 

The  optimal  regulator  for  (1)  with  respect  to  (6)  is  given  by 

u  =  -BTPx  (7) 

A 

with  P  being  the  positive  definite  symmetric  matrix  solution  to  the  Riccati 
equation 

PA  +  ATP  +  Q  +  PBBTP  -  PBBTP  =  0  (8) 

J 

Thus,  P  =  P,  and  the  controls  given  by  (£)  and  (7)  are  the  same.  Now  conifer  the  control 
given  by  (3)  and  (4).  If  L  >  0,  this  control  is  optimal  with  respect  to  the 

+  PBLBTP)  x  +  uTL_1u}dt  (9) 


performance  index. 
J  *  j  <xT(Q 


since  the  optimal  control  is  given  by 

u  =  -(L'1)'1  BTPx  =  -LBTPx 

where  0  *  PA  +  ATP  +  (Q  +  PBLBTP)  -  PB(L_1 )_1  BTP 
*  PA  +  ATP  +  Q 


If  L  is  singular,  the  control  v  s  Tu  is  optimal  with  respect  to 


J  «J*{xT(Q  +  PBLBTP)  x  +  vTv}dt 


(10) 

(ID 

(12) 


Fr 
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for  the  system 

x  »  Ax  +  BLTTV  03) 

where  TTT  *  L+  (the  pseudo- Inverse  of  L)  (14) 

since  v  =  -  (BLTT)T  Px  (15) 

and  0  =  PA  +  ATP  +  (Q  +  PBLBTP)  -  P(BLTT)(BLTT)TP 

*  PA  +  ATP  +  Q  +  pblbtp  -  pbltttlbtp 

*  PA  +  ATP  +  Q  (16) 


Thus,  the  closed  loop  system  given  by  (13)  and  (15)  is  stable,  i.e. 

x  -  (A  -  BLTT(8LTT)TP)x 
*  (A  -  BLTTTLBTP)x 

»  [A  +  B(-LBTP]x  (17) 


is  stable.  But  (17)  Is  the  same  closed  loop  system  as  that  obtained  using  the 
control  (4)  In  the  system  (1).  This  verifies  the  stability  properties  or 
Integrity  property  of  regulators  of  the  special  class  of  regulators  described 
In  the  introduction. 


Characterization  of  Regulators  Defined  by  (2)  and  (3).  A  simple  method  of 
characterizing  such  regulators  is  to  relate  their  closed  loop  parameters 
to  the  closed  loop  parameters  of  optimal  linear  regulators.  This  method  can 
be  applied  to  second  order  systems  with  a  single  Input,  but  appears  to  be 
Intractable  for  general  systems.  For  the  simple  example  with 


A 


0 


a  >  0,  b  >  0 


(18) 


Single  Input  systems  also  demonstrate  that  the  set  of  controllers  defined  by 
(2)  and  (3)  Is  a  conservative  estimate  of  the  set  of  controllers  with  Integrity 
because  all  stabilizing  controllers,  for  single  Input  systems  possess  Integrity 
with  respect  to  Input  outages. 


.. . _ 


^  - - 


.'Ll 
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2 

the  closed  loop  characteristic  polynomial  Is  s  +  C^s  +  C2*  Consider  the 
two  control  laws,  uL  defined  by  (2)  and  (3),  and  uR  defined  by 

uR  *  -BTPrx  (19) 

with  PR  >  0  satlsying  the  Rlccati  equation 

PrA  +  ATPr  +  Qr  -  PrBBTPr  =0  (20) 

The  corresponding  coefficients  in  the  closed  loop  characteristic  polynomial 
are: 


CIL  *  b  +  (q22/2b)  +  (q11/2ab),  C2t  «  a  +  (qn/2a)  (21) 

CIR  ’  I*2  *  «22R  +  2(  I3*  *  <'11R  C2R  *  /  +  ’HR  <22> 

The  sets  of  possible  coefficients  for  these  two  control  laws  may  be  depicted 
In  the  (Cj.Cg)  plane  as  shown  In  Figure  1.  The  set  for  uL  is  a  subset  of  the 
set  for  uR.  The  lower  boundaries  of  these  two  sets  coincide  (the  line 
segment  =  a,  >  b).  The  upper  boundary  for  the  uR  set  Is  the  segment 
of  the  parabola  C.j2  =  b2  +  2(C2-a)  with  Cj  >  b.  The  upper  boundary  for  the 
set  Is  the  line  segment,  b(C1  -  b)  =  C2  -  a,  >  b  which  is  tangent  to 


FIGURE  1.  Possible  Closed  Loop  Characteristic 
Polynomial  Coefficients 


1 


- - -  ■  •  ^  — 


. .  -r— 


The  sets  of  possible  closed  loop  roots  may  also  be  determined  for  this  example. 
Figure  2  shows  these  sets  for  the  case  of  a  *  b  =  2.  The  negative  real 
axis  Is  contained  In  the  possible  sets  for  both  u^and  u^.  The  remaining 
set  of  possible  roots  for  Is  a  small  subset  of  the  set  of  possible  roots  for 
Upj.  Although  these  results  appear  to  be  impossible  to  generalize,  let  us 
note an  Interpretation  of  the  sets  of  possible  roots  In  this  example  that  may 
be  generalized.  If  we  Introduce 


FIGURE  2.  Possible  Closed  Loop  Roots 


a  positive  scalar  parameter  a  In  the  matrices  Q  and  Q0,  say  Q  ■  afl  and 

A  n  K 

Qr  “  ®Qr  and  consider  the  loci  of  closed  loop  roots  as  o  tends  to  Infinity, 
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a  a 

these  loci  tend  to  zeros  associated  with  Q  and  QR.  For  this  example  there  is 
at  most  one  such  zero  and  It  must  be  real  and  negative.  In  the  optimal  case, 
the  zero  Is  a  transmission  zero  associated  with  QR  and  Its  magnitude  Is  arbitrary. 
In  the  case  where  u^  is  obtained  via  (2)  and  (3)  the  magnitude  of  the  zero 
associated  with  Q  is  restricted  to  be  less  than  b. 

In  this  example  the  root  locus  of  Interest  Is  the  locus  of  roots  of  the  polynomial 

p(s,ca  »  s2  +  2[b  +  (*'2ab)(qn  +  aq22)]  +  a  +  (a/2a)  q„  (23) 

As  «  tends  to  Infinity,  the  polynomial  may  be  factored  as 

P(s,o)  *  [s  +  bq^/t^+aq^)  +  0(a_1)][s  +  (a^abMq^+aq^)  +  0(1)]  (24) 

so  that  one  root  tends  to  -bqn/(qn+aq22)  >  -  b  and  the  other  root  tends 
to  Infinity. 


Let  us  now  return  to  the  general  case  for  the  system  (1)  and  Introduce  the 
parameter,  a.  Into  the  control  law,  l.e. 

u  *  -aBTPx  (25) 


with  P  given  by  (3>  Such  a  system  may  be  characterized  by  asymptotic  properties 
as  the  parameter,  o,  tends  to  infinity.  The  return  difference  matrix  Is 

T(s)  »  I  +  aBTP(sI-A)_1B  (26) 

Algebraic  manipulation  leads  to  the  result  that 

TT(-s)  T(s)  »  I  +  aBT(-sI-AT)"1Q(sI-A)"1B 

+  a2  BT  (-sI-aV1  PBBTP(sI-A)”1B  (27) 

Let  the  dimension  of  x  be  n  and  the  dimension  of  u  be  m.  For  simplicity, 
let  us  assume  that  BTPB  has  full  rank.  A  generalization  to  the  case  In  which 
the  rank  of  BTPB  Is  less  than  m  Is  of  Interest  but  Is  also  somewhat  more 
complicated.  If  we  let  s  ■  ao  In  (27)  and  let  a  tend  to  Infinity,  we  obtain 


i 

$ 

i 

\ 


r, 
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TT(-oo)  T(ooM  -  a'1  cf 2  BTQB  -  0"2BTPBBTPB  .  . 

-kj"2  [a2 I  -  BTPBBTPB] 

We  also  note  that 

4>c(-s)<|>c(s)  *  <j>o("s)  <bQ(s)  det  [TT(-s)  T(s)]  (29) 

where  4»c(s)  denotes  the  closed  loop  characteristic  polynomial  and  $  (s) 
denotes  the  open  loop  characteristic  polynomial.  Since  the  closed  loop 
system  Is  stable  for  all  a  *  0,  we  can  deduce  from  (28)  and  (29)  that 
m  closed  loop  poles  tend  to  infinity  and  are  asymptotic  to 

s“  =  -a/x1(BTPBBTPB),  1=1 , 2,..., m  (30) 

*  -a  Xj(BTPB),  1=1, 2, ...,m 


where  x(A)  denotes  an  eigenvalue  of  the  matrix  A.  The  remaining  n-m  closed  loop 
poles  approach  finite  values  which  are  the  left  half  plane  Images  of  the  zeros 
of  the  determinant  of  B^P(sI-A)”^B.  Denote  these  left  half  plane  finite  zeros 
by  s9,  1*1 ,2,..., n-m.  The  eigenvectors  associated  with  the  finite  zeros  are 

1  T 

orthogonal  to  B  P  and  are  given  by 

X?  •  (s°  I-A)"1  By  J  ,  1=1 ,2,. ...n-m  (31) 

with  the  y®  determined  by 

BTP(s°  I-A)"1  B  y°  «  0,  1=1,2 . n-m  (32) 

The  eigenvectors  associated  with  the  asymptotically  infinite  eigenvalues  are 
given  by 


Xj  ■  B  Y  1*1,2,... „m  (33) 
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with  y"  determined  by 

Xi(BTPB)y“  «  -BTPB  y",  1=1, 2,..., m  (34) 

These  results  are  similar  to  those  obtained  for  optimal  regulators.* 

For  the  optimal  regulator,  however,  the  asymptotic  eigenvalues  and  eigenvectors 
are  related  to  the  weighting  matrices  QR  and  RR.  Here,  unfortunately  the 
relation  Is  to  P  which  Is  In  turn  related  to  Q,  but  a  direct  relationship 
to  Q  Is  not  available. 

In  the  special  case  for  which  BT  =  [0  bJ]  with  B1  an  mxm  nonsingular  matrix, 
which  would  be  the  common  representation  for  systems  with  actuator  dynamics, 
we  can  proceed  one  step  further.  In  this  case,  let  v“  =  B-jy".  Then  from 
(33) 


and  from  (34) 

»  -B1(BTPB)  B-j”1  v*  *  -B^j  P4  yTv  1-1.2 . m  (36) 

where  P^  Is  the  lower  right  mxm  block  of  P.  If  we  set  N  *  [v*»\>2»...,v^]  and  A  . 

*  dlag  (xp,  then  (36)  may  be  written  as 

NA  =  -B^^N  (37) 

Thus, 

P4  «  -(B^jVW1  (38) 

and  the  fact  that  Is  symmetric  Implies  constraints  on  N  and  A,  which  may  be 
Interpreted  as  constraints  on  actuator  couplings  and  relative  bandwldths. 

♦"Quadratic  Weights  for  Asymptotic  Regulator  Properties",  C.A.  Harvey,  6.  Stein, 
IEEE  Trans,  on  Auto.  Control,  Vol.  AC-23,  June  1978. 


The  fact  that  the  finite  zero,  s°,  was  constrained  In  the  simple  example  Is 
«  property  that  Is  common  to  the  general  case.  Adding  2s°P  to  both 
sides  of  equation  (3)  and  rearranging  yields 


P(s°I-A)  +  (s?I-A)TP  -  Q  +  2s°P  (39) 

Multiplying  equation  (39)  on  the  right  by  V°  =  (s°I-A)  ^  and  on  the  left 
by  (v°)T  yields 

2(y?)TBTP  v?  »  (v°)T  (Q  +  2sJp)v?  (40) 


But,  BTP  v° 


BTP(s°I-A)_1  By° 

(»°)T  o  A 

2(v°)T  P  v° 


0  from  (32),  so  that 


and  It  follows  that 


(41) 


(42) 


where  o(Q)  Is  the  largest  singular  value  of  Q  and  g.(P)  Is  the  smallest  singular 
value  of  P.  Thus,  (42),  shows  that  the  magnitudes  of  the  finite  zeros  are  bounded, 
but  the  bound  Involves  P  and  Q.  Since  P  Is  a  function  of  A  and  Q,  the  bound  is 
an  Implicit  function  of  A  and  Q.  Unfortunately,  the  explicit  dependence  Is  not 
evident. 


An  alternate  characterization  of  controllers  defined  by  (2)  and  (3)  can  be  derived 
by  considering  the  optimal  controllers  for  (1)  with  respect  to  the  performance 
index 
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with  B  a  small  positive  scalar  parameter.  In  this  case  the  optimal  controller 
can  be  represented  as 

u  *  -BT(J^  3^  P^)x  ^  (*4) 

where 


Equating  terms  of  like  powers  of  3  in  equation  (45)  yields 
P0A  +  ATPq  =  PQ  B  BT  Pq 
p,»  *  atp,  ♦  q  •  P0B  btp,  *  P,B  BTP0 
etc. 

With  A  being  a  stable  matrix,  PQ  *  0,  so  that  the  right  hand  side  of  (45b) 

Is  zero.  Thus,  the  equation  for  P^  Is  the  same  as  equation  (3),  and  controllers 
defined  by  (2)  and  (3)  may  be  viewed  multiples  of  first  order  approximation 
to  optimal  controllers,  l.e. 

U  •  -BTP,X  •  -bt  ^  [5-  £.  <46) 

1*0 

Another  way  of  describing  this  characterization  Is  to  consider  the  controller 
given  by  (2)  and  (3)  with  Q  In  (3)  replaced  by  BQ-  Then  this  controller  is  the 
first  order  approximation  to  the  controller  given  by  (44)  as  3  tends  to  zero. 
This  Implies  that  the  closed  loop  root  loci  (parameterized  with  3)  associated 
wlth  ttpse  controllers  are  tangent  at  3*  0  whtch  corresponds  to  the  open  loop 
roots. 


(45a) 

(45b) 


Jill 
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ABSTRACT 


Some  control  law  design  examples  for  the  CH-47  helicopter  are  used  to 
explore  and  illustrate  the  role  of  singular  value  analyses  in  multi¬ 
variable  design. 


1.0  INTRODUCTION 

Design  techniques  for  linear  multivariable  control  systems  have  long 
suffered  from  the  lack  of  reliable  measures  of  "robustness".  By 
robustness,  we  mean  an  intentionally  designed  tolerance  for  differences 
between  the  nominal  plant  model  used  for  design  and  the  actual  plant 
being  controlled.  Such  differences  arise  as  a  result  of  parameter 
variations,  neglected  dynamics,  approximated  functional  relationships, 
nonlinearities,  etc.  They  are  present  to  some  extent  in  all  physical 
systems.  Critical  closed  loop  properties  such  as  stability  must  therefore 
be  designed  to  remain  intact  in  the  face  of  these  differences,  and  key 
performance  variables  should  exhibit  only  weak  dependence  on  them. 

Cor  single  input  single  output  systems,  the  degree  to  which  such  tolerance 
is  achieved  has  been  historically  (and  reliably)  measured  in  terms  of  the 
minimum  distance  of  a  loop's  Nyquist  diagram  from  the  so-called  critical 
point  (-1,0)  in  the  complex  plane  [1].  The  familiar  concepts  of  phase 
margin  and  gain  margin  are  measures  of  this  distance  and  are  often  speci¬ 
fied  as  explicit  minimum  robustness  requirements  of  control  loops  [for 
example,  2]. 

Many  attempts  have  been  made  to  apply  these  measures  of  robustness  to 
multivariable  systems.  A  common  engineering  practice,  for  example,  is  to 
measure  gain  and  phase  margins  of  individual  loops  one  at.  a  time  with 
other  loops  variously  open  or  closed.  More  formal  methods  have  been 
advocated  by  Rosenbrock  [3],  who  applies  these  measures  to  the  inverse 
Nyquist  plots  of  diagonally  dominant  systems,  and  by  MacFarlane  et  al.  [4], 
who  apply  them  to  the  eigenvalue  (or  characteristic  loci)  plots  of  multi- 
variable  systems.  All  of  these  approaches  have  been  shown  to  be  unrealis¬ 
tic  in  the  sense  that  a  lack  of  tolerance  in  certain  directions  goes 
undetected  [5].  In  effect,  the  methods  can  indicate  that  all  is  well  with 
respect  to  robustness  when  dangerous  sensitivities  in  fact  exist. 

The  concept  of  singular  values  of  matrix  transfer  functions  has  recently 
been  applied  to  overcome  this  reliability  problem.  In  [5],  Doyle 
established  a  multivariable  stability-robustness  theorem  which  guarantees 
that  a  stable  multivariable  control  system  will  remain  stable  in  the  face 
of  multiplicative  model  perturbations  whenever  the  singular  values  of  these 
perturbations  remain  appropriately  bounded.  This  result  has  since  been 
shown  by  Sandell  [6]  to  be  a  special  case  of  a  general  tnvertability 
condition  for  stable  perturbed  operators.  It  is  also  implicit  in  the 
recent  stability  results  of  Safonov  [7]  .  When  it  is  combined  with 
‘Tins  work  was  supported  by  the  Office  of  Naval  Research  under 
Contract  No.  NOOOM-  'S-C-0144. 


efficient  coinputat icnal  procedures  for  singular  value  decomposition  and 
with  tight  bounding  formulas  for  the  magnitudes  of  model  perturbations  the 
result  appears  to  provide  a  valuable  new  multivariable  design  tool. 

It  is  the  intent  of  this  paper  to  explore  and  illustrate  the  role  which 
singular  value  analyses  might  play  in  multivariable  design.  We  do  this  by 
means  of  some  trial  control  design  examples  for  the  longitudinal  degrees 
of  freedom  of  the  CH-47  helicopter.  Iri  forward  flight,  this  vehicle 
exhibits  coupled  pitch  attitude  and  vertical  motion  dynamics  which  must 
he  controlled  by  coordinated  actuation  of  two  inputs.  This  offers  a 
realistic,  yet  manageable  desiqn  example.  We  begin  the  discussions  in 
Section  II  with  a  quick  review  of  Doyle's  stabi 1 i Ly- robustness  result  and 
of  some  bounding  formulas  for  model  perturbations  recently  developed  by 
Safonov  [8].  Specifics  of  the  CH-47  design  problem  are  given  in  Section 
III  and  IV,  and  various  trial  designs  are  discussed  in  Section  V. 
Conclusions  and  some  open  research  questions  are  given  in  Section  VI.  We 
caution  all  readers  to  consider  the  control  laws  presented  as  illustrative 
only.  They  are  not,  and  are  not  intended  to  be,  final  "flight  quality" 
designs. 


2.0  MULTIVARIABLE  ROBUSTNESS  CONCEPTS 

We  consider  finite  dimensional,  linear,  time-invariant  multivariable  feed¬ 
back  loops  represented  in  the  frequency  domain  as  shown  in  Figure  1*.  The 
matrix  G  (s)  represents  the  nominal  plant  transfer  function,  and  L(s) 
represents  a  multiplicative  perturbation  such  that  the  actual  plant  is 
given  by 

G(s)  =  G0(s)  Cl  t-L(s)].  (1 ) 

If  L ( s )  and  the  nominal  closed  loop  system,  (I+r.0)-1G0,  are  both  stable 
then  the  following  result  holds: 

Theorem 

The  perturbed  c<osed  loop  system  remain:,  stable  for  all  perturbations  L(s) 
such  that 

«tL(s)]-  a[  I  +Cit~)1  ( s )  ]  (2) 

for  all  complex  frequencies,  s,  on  the  classical  tlyquist  0-contour.  Here 
the  symbols  oLAJ  and  _j  [aJ  denote  the  maximum  and  minimum  singular  values 
of  matrix  A,  respectively^  with  singular  values  being  defined  as  the  square 
roots  of  eigenvalues  of  A  A.  Equation  (2)  immediately  suggests  that  the 
function  oU+Gq1  (s)J  ,  .$>  provides  a  reliable  measure  of  multivariable 
robustness--the  bigger  o,  the  better.  Moreover,  since  this  function  is 
equal  for  s=+jw  and  tends  to  infinity  on  the  infinite  segment  of  the 
D-contour  (at  least  for  all  physical  systems),  it  suffices  to  look  at  the 
singular  values  for  real  positive  frequencies  only,  i.e.,  the  system 
remains  stable  if 

j[L(jw)]<  a[l,r'o'  (jw)]  (3) 

for  all  0  <  a)  •:  ■>•. 


'More'  general  systems  can  be  treated  with  Aandell's  [6]  and  Safonov's 
1 7J  generalizations. 


**The  D-contour  encloses  the  right  half  plane  with  three  segments:  1) 
s=jw,  0<u)«»  ;  2)s=Rc*Jtf,  R-*.. ,  _^<0<  £*  3)  s-jw  -o-s.kO.  It  is  usually 
indented  to  exclude  singularities  along  this  rath. 


(i.e.,o  and  q  vs.i*i)  to  measure  system  robustness, 
plots  as  sigma-plots  for  convenience. 


We  will  refer  to  these 


In  order  to  utilize  equation  (3),  it  is  necessary  to  be  able  to  calculate 
singular  values  efficiently  and  to  tie  able  to  characterize  realistic 
perturbations  L($)  for  complex  systems.  Numerical  procedures  for  the  first 
requirements  are  discussed  by  Laub  in  [9].  The  second  requirement  is 
satisfied  to  substantial  degree  by  the  following  composite  sectoricity 
results  due  to  Safonov  [rt]*. 

Consider  the  system  diagram  shown  in  Figure  2.  The  matrices  GQ,  GVy,  Ge 
and  Gey  are  nominal  transfer  functions  of  our  original  plant  with  its  eU 
block  diagram  redrawn  such  that  the  uncertainties  of  individual  components 
are  all  collected  into  one  perturbation  matrix;  dia  [cj(s)  i  =  1,2,...,N]. 
Ihe  c.'s  are  nominally  zero  and  are  assumed  to  have  known  individual  bounds 

<fri(jw)|  (4) 

Let 


i  c:  i  ( j  w ) 


where  the  r- 's  are  stable,  minimum  phase,  rational  transfer  functions. 
R  =  diag(r^ J  and  let 

a)  the  nominal  system  be  stable,  and 

b)  the  matrix  M  ~  I-Gev  R  RGpv  be  uniformly  positive  for  all  m. 

lben  the  perturbed  system's  transfer  function  matrix  will  belong  to  a 
"conic  sector"  (a  circle  in  the  frequency  domain)  defined  by 


1[Q,'2(jw)(G(jw)-Gc(jw))  P''2(jw)]<l  for  all  to 
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(6) 

(7) 

(8) 


Note  that  equations  (L)-(3)  provide  a  way  to  compute  bounds  for  the  total 
perturbation  L(s)  in  Figure  1  from  know  bounds  for  individual  component 
elements  of  the  plant. 


ill.  Tin;  example  nrsiGN  problem 


To  examine  the  potential  utility  of  the  above  concepts  in  multivariable 
system  design,  wo  will  treat  a  longitudinal-axes  design  problem  for  the 
□1-47  helicopter.  This  vehicle  is  a  tandem  rotor  machine  whose  physical 
characteristics  and  mathematical  models  are  given  in  [10].  Control  over 
vertical  motions  is  achieved  by  simultaneous  changes  of  blade  angle-of- 
attack  on  both  rotors  (collective),  while  pitch  and  forward  motions  are 
controlled  by  changing  blade  angle  differentially  between  the  two  rotors 
(differential-collective).  These  blade  angle  changes  are  transformed 
through  rotor  dynamics  and  aerodynamics  into  hub  forces  which  then  move 
the  machine. 

Our  objectives  will  be  to  design  a  command  augmentation  control  law  which 
achieves  tight,  non- interacting  control  of  the  vertical  velocity  and 
pitch  attitude  responses.  A  small  perturbation  linearized  aircraft  model 
should  prove  adequate  for  this  purpose  and  is  available  from  [l0].  The 
state  vector  consists  of  the  vehicle's  basic  rigid  body  variables 
x  =  (V.z.q.O)  (forward  velocity,  vertical  velocity,  pitch  rate,  pitch 
angle).  Two  integrators  are  appended  to  achieve  integral  control  of  the 
primary  responses,  mid  controls  are  the  collective  and  differential- 


1  lective  inputs  described  avove,  u  ( ■ 

, dc  )  .  Ill'll!  r 

,  the  design  model  is 

x  =  Ax  +  Hu  A,B  in 

Lio] 

(9) 

*5  ‘  1  S:,«l 

(10) 

x6  s  *  °cmd 
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The  major  approximations  associated  with  this  model  are  due  to  neglected 
dynamics  of  the  rotors,  to  neglected  nonlinearities  in  the  blade  angle 
actuation  hardware,  and  to  variations  of  the  A,B  matrices  with  operating 
point  (flight  condition  variations).  We  will  treat,  modelling  errors  due 
to  these  approximations  as  sources  of  the  perturbation  L(s)  in  Figure  1  and 
will  attempt  to  make  controllers  robust  with  respect  to  them. 

IV.  CHARACTERIZATION  Of  l(s) 


In  view  of  the  stability-robustness  theorem  cited  earlier,  it  is  not  unjusti¬ 
fied  to  consider  nominal  design  models  to  be  incomplete  unless  they  are 
accompanied  by  estimates  of  the  function  o[L(s)].  (How  else  can  a  designer 
assure  the  required  degree  of  robustness?)  Such  estimates  are  developed 
in  this  section  for  the  model  in  equations  (9)-(ll). 

Perturbations  Due  to  Rotor  Dynamic s 


Elementary  dynamic  and  aerodynamic  analyses  of  rotating  airfoils,  hinged 
at  the  rotor  hub,  indicate  that  lift  forces  will  not  be  transmitted  to  the 


hub  instantaneously  with  collective  changes  in  blade  angle-of-attack  but 
will  appear  only  when  the  cone  angle  of  the  rotor  has  appropriately 
changed.  The  dynamics  of  the  latter  have  been  shown  to  he  damped  second 
order  oscillations  with  natural  frequency  equal  to  rotor  speed  and  damping 
determined  by  somewhat  uncertain  aerodynamic  effects  [11].  Hence,  rotor 
dynamics  can  lie  crudely  represented  by  second  order  transfer  functions 


gR(s.c) 


+  2>>rfu'R 


with  '.)p=2 5  and  r.  conservatively  confined  to  the  range  0.1  <  ^  <  l.o. 
Because  collective  and  differential -col lective  inputs  both'involve  coning 
motions  of  the  rotors,  one  such  transfer  function  will  appear  in  each 
control  channel.  Since  these  dynamics  are  neglected  in  equation  (9),  it 
then  follows  that  any  perturbatod  transfer  function  matrix  computed  from 
Table  1  will  have  the  form 


G  =  Gq( I+L)  «  Go  diag  (gR) , 
and  hence, 


(13) 


L  =  diag  (g..-l) 

o[L  ]  ;  nwx 


(14) 

(15) 


Tli  is  function  was  evaluated  for  a  range  of  s-jw  values  (with  brute  force 
maximization  over  i. )  and  is  shown  by  the  solid  lines  in  figure  3. 


I  igure  3  also  shows  an  alternate  hound  for  ,-,[l  ]  developed  from  Safonov's 
formulas,  equation  (f»)-(8).  In  this  case,  the  rotor  dynamics  are  redrawn 
as  in  figure  c  ,  with  nominal  damping  value,  0.65,  plus  an  internal 

component  perturbation ,. Sr ,  bounded  by  0 

|6d  <  |r  with  r*0-<5 


f  161 


and  according  to  (5),  tin?  rotor  dynamics  at  each  frequency  then  belong  to 
a  circle  in  the  complex  plane  with  center,  <’jR,  defined  by  (6)  and  radius, 
given  by  -v/  p/g*1  with  scalars  p  and  q  defined  by  (7)  and  (8),  Using 
trtis  circle  in  (  I4)gives  the  bound 

3[L]<|9R-1|  +V  08) 

which  is  plotted  in  Figure  3.  Note  that  this  "Safonov  bound"  is  slightly 
more  conservative  than  equation  (11)  because  it  admits  a  larger  class  of 
damping  perturbations-- i  .e.  ,  6r,  in  (13)  may  itself  be  a  dynamical  operator. 

Perturbations  Due  to  Rate  I.  imi  ts 

In  addition  to  the  dynamics  of  rotors,  each  control  channel  of  the  CH-47 
also  exhibits  various  nonlinearities  which  are  neglected  in  the  nominal 
design  model.  Of  these,  the  rate  limit  nonlinearity  imposes  the  greatest 
dynamic  constraint  on  performance,  and  we  consider  bounds  only  for  this 
one  effect. 

An  approximate  model  for  rate  limits  on  the  CH-47  is  given  by 

“  ■  \m  SA1  l  09> 

where  SAT(  )  denotes  the  standard  saturation  nonlinearity,  saturating  at 
+  1.  Bounds  for  this  model  can  be  developed  with  Safonov's  procedure  by 
treating  the  SAT  element  as  an  uncertain  component.  For  example,  if  we 
are  prepared  to  restrict  our  system  to  functions  r,( t)  whose  Li;i-norms  are 
less  than  some  multiple  of  the  limit,  say 

IU!lu<ri.  n  >  1.0,  (20) 

lht;n 

SAT ( c, )  =  ( 0 . *  0.5/n)  +  (l;C)g  (21) 

with  |  6c |  <  |  r  1  ••  0.5  -  0.5/n 

T ho  tc  perturbations  are  nonlinear,  of  course,  and  equation  ( 5 ) - ( 8 )  do 
not  apply  to  them  as  stated.  Fortunatoly.  reference  [8]  shows  that  the 
bounds  are  still  vali.l  for  these  and  other  more  general  perturbations. 
Hence,  the  rate  limit  rmnl  irieari ties  belong  to  a  conic  sector  and  have  a 
■ » [L j  bound  analogous  to  (19).  This  bound  is  plotted  in  Figure  3  (dashed 
lines)  for  several  values  of  the  magnitude  ratio  r).  Note  that  as  n 
becomes  large,  the  bound  approaches  unity  at  all  frequencies.  This  is 
cunsistant  with  physical  intuition,  since  the  effective  gain  across  rate 
limited  nonl inearities  will  approach  zero  for  large  signal  levels. 

Perturbations  Due  to  Operating  Point 

The  third  major  source  of  model  uncertainty  is  the  variation  of  A,  B 
matrices  with  flight  condition.  Such  "component"  variation  could  again  be 
translated  into  an  overall  bound  for  l(s)  via  Safonov's  procedure.  In 
this  case,  however,  the  result  would  bo  unduly  conservative  because 
coefficient  variations  tend  to  be  highly  correlated  and  are  not  arbitrary 
dynamical  operators.  A  more  direct  way  to  compute  the  bound  is  to  solve 
(1)  for  l(s)  with  Known  0(s)  matrices  and  t.o  maximize  over  a  number  of 
representati ve  flighi  conditions,  i.e.. 


O  L(jw)  =  max  y  [G'^jw)  G.(jw)  -  I  ]  (22) 

Results  of  this  process  are  shown  by  the  dotted  line  in  figure  3.  We  see 
the  (initially  surprising  result  that  ~i[l  )  becomes  quite  large  at  low 
frequencies.  This  happens  because  the  basic  helicopter’s  low  frequency 
modes  are  stableat  some  flight  conditions  and  unstable  at  others. 
(Theoretically,  5  G(jw)  will  approach  infinity  for  frequencies  and  flight 
conditions  where  these  modes  cross  the  jw-axis.  Tins  means  that  the 
perturbations  exhibited  by  our  plant  are  not  necessarily  stable  and,  hence, 
the  stability-robustness  theorem  cited  in  Section  II  fails  to  apply.  We 
will  see  later  that  stable  controllers  can  still  be  obtained  and  that  the 
ability  to  incorporate  unstable  L’s  in  a  generalized  multivariable 
stability-robustness  theory  appears  to  be  an  important  research  topic.  For 
the  moment,  however,  our  designs  will  be  restricted  to  individual  flight 
conditions  for  which  the  dotted  L’s  in  figure  3  can  be  disregarded. 


V.  TRIAL  CONTROL Lf R  DESIGNS 

A  bit  of  contemplation  of  equation  (3)  and  the  uncertainties  given  in 
figure  3  shows  that  t he  stabi 1 i ty- robust ness  theorem  basically  works  by 
imposing  a  "multivariable  bandwidth"  limitation  on  the  feedback  loop. 
Magnitudes  of  l(jw)  tend  to  be  large  (unity  or  greater)  beyond  certain 
frequencies,  requiring  G~  to  be  large  and  consequently  G  to  be  small. 

This  is  most  readily  illQstrated  with  a  single  loop  example  where  plots  of 
the  function  ja[l+g”'j  reduce  to  the  inverse  closed  loop  frequency  response, 

-OQ+g-1]  =  |  — ^  |  =  I  — -|  .  (23) 

J  Jcl 

The  condition  that oL  leg  be  large  then  translates  directly  into  the 
high-frequency  “roll -off"  requirement  commonly  imposed  on  classical 
control  loops  [  l]  .  We  begin  with  such  an  example. 


Single  Loop  Pitch  Attit ude  Corn ro 1 


The  vertical  velocity  and  pitch  attitude  motions  of  the  nominal  CH-47  model 
at  hover  uncouple  naturally  into  two  non-interacting  channels-- 
(z,  Xr)  controlled  by  (c),  and  ( v , q , , ,xf)  control  led  by  (dc).  The  hover 
flight  condition  thus  offers  an  attractive  single  loop  design  case.  Sigma- 
plots  for  several  trail  pitch-motion  controllers  for  this  case  are  shown 
in  I igure  4.  These  controllers  were  all  designed  with  the  linear- 
quadratic  methodology  (selected  largely  for  convenience)  and  correspond  to 
the  following  cost  functional: 

J  -  f  (57.3  >  P(dc)?  dt  (24)* 

with  f  =  900.,  9.0.  0.09,  and  1.0,  respectively,  for  the  four  trials.  As 
expected,  bandwidth  of  these  control  lei's  increases  with  decreasing  p  and 
eventually  violates  the  stability-robustness  constraint  imposed  by 
neglected  rotor  dynamics  (lor  the  moment  we  ignore  rate  limits  and  flight 
condition  variations).  That  this  violation  actually  produces  instabili¬ 
ties  was  verified  by  computing  closed  loop  roots  of  the  trail  controllers 
in  the  presence  of  the  rotor.  Trial  3  is  unstable!  Our  options  are 
therefore  to  restrict  bandwidth  to  approximately  Trial  2  or  to  provide 
additional  roll-off  beyond  t.he  maximum  ?0  db/dccade  attenuation  inherent 
in  l Q-designs  L13l.  The  latter  option  is  illustrated  by  Trial  4  which  uses 
a  jj- value  somewhat  smaller  than  Trial  2  but  includes  a  low-pass  filter  at 


•These  weighting  -.elect  inns  are  motivated  by  the  "asymptotic" 
of  Reference  Il2  .  They  achieve  a  single  clow  mode  near  the 
for  forward  speed  and  a  third  order  (asymptut  i c\ [iutterworf h 
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loop  frequency  response.*  are  wol 1 -shaped  for  all  pure  LQ-trials  and  that 
Triol  ‘1  achieves  extia  l.andwidth  at  t. h< »  expense  of  slightly  larger  M-peaks. 

Mu I  t i - 1 cop  Desigi i  s 

Maxjnii z in^L  Uandwid'  I.- -Tin*  beauty  of  singular  values  is  that  the  above 
stability-robustness  analyses  carry  over  without  change  to  multivariable 
systems.  This  is  illustrated  in  Figure  5  with  some  trial  two-channel 
designs  at  a  40  knot  fotward  speed  flight  condition.  These  controllers 
are  again  of  the  l.Q-type,  this  time  using  the  cost  function,, 

0  =jT'  (x5)?  ♦  (57.3  x6)2  +  f,(c)2  +  P2(dc)2  dt,  (25) 

with  (p.^)  =  (10000,  900),  (9.0,  9.0),  and  (1.0,  1.0)  for  the  three 
trials  ihown.  The  distinction  between  figures  4  and  5  is  that  Figure  5 
shows  two  sigma-plots  for  each  trial,  corresponding  to  the  two  singular 
values  of  (I+G~l).  for  stability-robustness,  the  smaller  of  these  values 
must  fall  above  the  sigma-plot  of  L  at  all  frequencies.  The  larger 
value  i^  unspecified.  However,  in  order  to  maximize  bandwidth  "in  all 
directions",  it  is  reasonable  to  adjust,  the  relative  weights  (p,,p?)  such 
that  the  two  singular  values  are  approximately  equal  and  then  ti  push  them 
jointly  to  as  high  a  bandwidth  as  the  J[L]plot  p<?rmits.  (For  the  moment, 
we  again  use  only  neglected  rotor  dynamics  for  L.)  This  design  philosophy 
is  incorporated  in  the  three  trials  of  Figure  5.  The  first  trail  has  low 
bandwidth  and  substantial  differences  between  the  two  singular  values. 

These  differences  are  reduced  and  bandwidth  is  increased  in  the  next  trial. 
The  third  trial  serves  to  maximize  bandwidth  by  using  additional  roll-off 
filters  in  each  control  channel. 

Transient  Response-As  seen  from  these  trials,  singular  value  analyses 
appear  to  offer  a  convenient  way  to  maximize  mu) ti variable  bandwidth  sub¬ 
ject  to  stabi  1  i ty*robus ness  limitations.  The  next  design  step  is  to 
achieve  reasonable  command  responses  from  the  resulting  feedback  loop. 

One  way  to  do  this  is  to  place  a  command  shaping  filter  ahead  of  the  loop, 
as  indicated  by  the  dashed  box  in  figure  1.  for  feedback  loops  with 
integral  control  on  the  primary  responses,  such  sophistication  is  often 
unnecessary  because  coiiinands  inserted  at  the  integrators  (as  shown  in 
equations  (10)  and  (11))  produce  good  transients.  This  is  the  case  here, 
as  evidenced  by  the  responses  of  Trail  3  to  step  attitude  and  step  velocity 
commands  shown  in  Figure  6.  Note  that  the  loops  are  tight,  well  damped, 
and  non-interacting  as  desired. 

Rate  Limiting --So  far  we  have  ignored  model  uncertainties  due  to  rate 
limits.  This  was  done  because  there  is  iio  a  priori  way  to  select  the 
parameter  g  for  Figure  3,  which  is  determined  by  the  maximum  magnitudes  of 
signals  in  the  closed  loop.  Clearly,  for  n  sufficiently  large  all  our 
trial  designs  would  violate  the  rcsul  t  ing  u  [|_  ]  bound.  That  such  violations 
actually  correspond  to  instabilities  was  verified  by  repeating  the  trans¬ 
ient  responses  for  Trail  3  with  progressively  larger  attitude  commands. 
Unstable  behavior  occurs  for  Iff.  degrees,  with  go*  60. 

!n  order  to  improve  robustness  with  respect  to  rate  limits,  the  following 
iterative  procedure  may  l» •  used: 

1)  Assume  a  signal  level  limit  tt  ••  r, 

2)  Design  !  t  1  consistent  with  the  resulting  m[l] 

•According  to  ').  these  are  given  by  the  sigma-plots  of  Figure  4 
viewed  "upside  down". 


3)  Evaluate  the  actual  maximum  signal  level,  p,,  by  computing 
transient  responses  with  worst  case  commands  and/or  initial 
conditions 

4)  If  p.  andi|Q  are  substantially  different,  return  to  step  1 
withn  o  =  °o  +  c^r'l  *  n., )  -  *  $tt»P  otherwise 

An  illustration  of  the  first  iteration  of  this  procedure  is  given  in 
Figure  5  where  the  assumed  signal  level  n  -  20.  (the  dashed  g[L]curve) 
yields  a  controller  (Trial  2)  whose  actual  signal  level  is  n.  <  0.6.  The 
associated  transient  responses  are  slow  but  stable.  To  fine  tune  this 

design,  a  second  iteration  might  be  taken  with  r.  -  5. 

‘0 

Flight  Condition  Variations--Ue  noted  earlier  that  o[L]  due  to 
operating  point  changes  becomes  quite  large  at  low  frequencies  because 
the  helicopter's  slow  modes  are  not  stable  at  all  operating  points.  At 
intermediate  and  high  frequency  ranges,  however,  the  uncertainty  bounds 
are  reasonably  small  (Fig.  3).  This  suggests  that  if  the  loop  transfer 
matrix  6  ( s )  has  sufficient  low  frequency  gain  to  stabilize  the  slow  modes 
under  all  conditions,  then  the  design  might  well  be  stable  even  though  the 
(sufficient)  stability-robustness  condition  fails.  This  is  in  fact  the 
case.  Both  trial  design  No.  2  and  Mo.  3  remain  stable  at  8  representative 
flight  conditions  ranging  from  hover  to  160  knot  forward  speed  and  from 
+2000  ft/min  to  -  2000  ft/min  ascent  rates.  The  intuitive  idea  which 
underlies  this  result  (sufficiently  high  low  frequency  gain)  may  well 
provide  needed  insight  toward  a  generalized  multivariable  robustness 
theory  for  unstable  perturbations. 

VI.  CONCLUSIONS 

This  paper  has  presented  several  trial  control  law  designs  to  explore  and 
illustrate  the  role  which  singular  value  analyses  miqht  play  in  multi- 
variable  system  design.  The  examples  confirm  that  stability-robustness 
condition  (2)  provides  a  reliable  measure  nf  robustness,  and  they  show 
that  this  condition  offers  a  natural  way  to  limit  multivariable  band¬ 
width  during  the  design  process.  The  bounding  formulas  ( 5 ) - (8 )  were  seen 
to  be  very  useful  for  bounding  the  functions  [L]  ,  although  for  some 
situations  (e.g.,  flight  condition  variation)  they  tend  to  be  excessively 
conservative. 

Major  weaknesses  displayed  by  the  present  singular  value  stability- 
robustness  theory  include  its  inability  to  handle  unstable  perturbations 
and  its  implicit  tendency  to  limit  all  loop  bandwidths  to  be  consistent 
with  the  worst  case  L  direction.  Although  such  situations  did  not  arise 
with  the  helicopter,  it  is  easy  to  imagine  design  problems  where  some 
control  directions  have  large  L's  at  low  frequencies,  hence  calling  for 
low  bandwidth,  while  other  direction  have  smaller  L's,  hence  permitting 
greater  bandwidths,  it  is  then  unduly  conservative  to  restrict  all 
direction  to  the  slowest  case.  It  is  hoped  that  the  examples  presented 
here  will  help  to  motivate  further  research  to  overcome  these  weaknesses. 


*c  is  at  the  designers  discretion 
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INTRODUCTION 

In  the  past  two  decades,  dc  power  transmission  has 
provided  a  viable  alternative  to  ac  in  special  applica¬ 
tions  such  as  long-distance,  point-to-point  transmis¬ 
sion,  asynchronous  connection  between  power  systems  of 
different  frequencies,  and  interconnection  of  systems 
via  underground  and  undersea  cables.  Common  to  all 
these  applications  is  the  two-terminal  dc  link  which 
consists  of  a  rectifier  and  an  inverter  connected  by  a 
dc  transmission  line.  The  main  advantage  of  dc  trans¬ 
mission  lies  in  its  ability  to  transmit  a  large  block 
of  power,  with  very  little  loss,  from  one  part  of  the 
network  to  another  without  the  inherent  synchronous 
and  stability  limitations  of  ac  systems.  Although 
most  dc  links  to  date  are  built  for  the  purpose  of 
bulk-power  transmission,  it  was  discovered  recently 
that  by  modulating  the  dc  current,  a  dc  link  can  be 
used  as  an  extremely  effective  control  element  for  damp¬ 
ing  some  of  the  inter-area,  electromechanical  oscil¬ 
lations  in  an  integrated  ac/dc  system. 

The  successful  application  of  two  terminal  dc 
links  suggests  that  even  greater  flexibility  in  power 
dispatch  and  enhancement  in  stability  can  be  realized 
by  a  multiterminal  dc  (MTDC)  system  embedded  in  an 
interconnected  ac  grid.  Several  utilities  are  looking 
into  the  possibility  of  building  MTDC  systems  by  adding 
new  terminals  to  the  existing  dc  links  or  by  connecting 
dc  links  that  are  located  in  close  proximity.  It  is 
quite  conceivable  that  MTDC  will  become  a  major  part 
of  our  energy  delivery  system  by  the  end  of  this 
century. 

A  parallel  connected  MTDC  system  is  envisaged  as 
a  network  of  n  (n>2)  inverters  and  rectifiers  intercon¬ 
nected  by  dc  transmission  lines.  In  the  steady  state, 
n-1  converters  are  operated  under  a  constant-current 
node,  and  the  nth  converter  with  the  lowest  ac  com¬ 
mutating  voltage  (voltage  that  is  applied  to  the  ac 
side  of  a  converter)  is  operated  under  constant  delay- 
angle  or  constant  extinction-angle  mode  and  determines 
the  voltage  of  the  entire  MTDC  system,  in  a  transient 
condition  the  terminals  of  an  MTDC  system  can  poten¬ 
tially  be  modulated  in  a  coordinated  manner  to  damp,  out 
the  inter-area  electromechanical  oscillations. 

The  design  of  the  MTDC  control  system  offers  a 
unique  challenge i  since  it  involves  a  large-scale, 
multivariable  system  where  the  sensors  and  actuators  are 
situated  far  apart,  and  the  parameters  of  the  system 
are  difficult  to  estimate  and  may  change  abruptly  due 
to  failures  such  as  short  circuits  or  generators  out¬ 
ages.  A  workable  design  for  such  a  system  must  be 
sufficiently  robust  to  tolerate  actuator  and  sensor 
failures,  unmodelled  dynamics,  and  changes  in  system 
parameters.  Moreover,  economic  and  reliability  consid¬ 
erations  dictate  that  scow  form  of  decentralised 
feedback  scheme  be  used,  if  possible. 
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The  intent  of  this  paper  is  to  illustrate  how  the 
MTDC  control  problem  can  be  analyzed  from  a  physical 
viewpoint,  and  how  the  physical  insights  can  be  uti¬ 
lized  to  arrive  at  a  reasonable,  robust  control 
design.  The  main  emphasis  is  on  robustness.  Some  of 
the  latest  results  in  robustness  theory  are  used  in 
the  design  stage  as  well  as  in  analyzing  the  final 
design. 

Although  this  paper  presents  a  general  design 
methodology  for  an  MTDC  system,  a  hypothetical,  five- 
terminal  dc/ae  system  is  used  as  an  example  to  illus¬ 
trate  the  steps  of  the  design  process.  The  model  of 
this  system  is  described  in  Section  I,  and  a  physical 
interpretation  of  the  design  model  from  a  modal  pers¬ 
pective  is  given  in  Section  II.  Section  III  shows 
how  the  physical  insights  can  be  used  to  construct  a 
state  penalty  matrix  for  an  LQ  design,  and  the  concept 
of  gain  observability  is  utilized  to  study  the  trade¬ 
off  between  the  LQ  centralized  design  and  other  decen¬ 
tralized  schemes.  The  robustness  of  the  control  design 
is  studied  in  Section  IV,  after  a  brief  review  of  a 
relevant  theorem  in  robustness  theory.  Finally,  some 
results  of  the  open-  and  closed-loop  systems  are 
compared  in  Section  V. 

I.  MODELLING 

The  power  system  being  studied  consists  of  an  n- 
terminal  MTDC  system  embedded  in  an  ac  system  with  m 
groups  of  coherent  machines,  each  of  which  is  repre¬ 
sented  by  the  classical  constant-voltage-behlnd- 
transient-reactance  generator  model.  For  each  gener¬ 
ator  the  electrical  angle  6  is  governed  by  Newton's 
Second  law  for  a  rotating  mass i 

j!  ♦  D«  -  tm  -  P %  (1) 

where 

J  is  a  constant  related  to  the  inertia  of 
the  generator, 

Fa  is  the  mechanical  power  supplied  by  the  prime 
mover, 

p  is  the  electrical  power  injected  into  the 
power  network,  and 

D  is  a  constant  related  to  the  damping  of  the 
machine . 

It  is  further  assumed  that  the  mechanical  power  re¬ 
mains  constant  over  the  time  period  of  interest. 

The  dynamics  of  the  dc  converter  and  the  dc  net¬ 
work  are  ignored,  because  they  are  awch  faster  than 
the  electromechanical  dynamics  being  studied.  If  the 
dc  terminals  are  viewed  as  actuators,  this  implies 
that  the  control  action  is  equal  to  the  command  at 
all  time. 


I 


Under  these  assumptions,  s  linearized  model  is 
obtained  by  first  solving  for  the  steady-state  solu¬ 
tion  of  the  ac/dc  system,  and  then  linearizing  the 
equations  about  the  steady-state  point.  The  result  is 
e  linear  time- invariant  model  of  the  form 

x(t)  -  Ax(t)  ♦  Butt)  (2) 


The  reason  for  the  adjective  "right”  and  "left"  is 
obvious  by  noting  that 

AV  -  VA  (6 

NA  -  Ah  (1 


A  T 

x  -  (&i^,A<i>1,...,A6a,duB)  are  the  changes  in 

electrical  angle  and  frequency  of  the  m 
generators, 

4  •  x 

u  •  (Al.,...,  Al  )  are  the  changes  in  current 
■—  «  n 

injected  by  the  dc  terminals. 

(The  current  injection  of  the  first  dc  terminal  is 
not  s  control  variable) .  A  and  B  are  matrices  of 
appropriate  dimension. 

In  the  subsequent  discussion,  the  "A"  symbol  will 
be  dropped,  and  all  quantities  are  deviations  from  the 
steady-state  solution  unless  otherwise  specified. 

It  is  Important  to  emphasise  that  the  design  model  (2) 
does  not  take  into  account  the  dynamics  associated 
with  the  excitation  system,  power-system  stabilizer, 
shaft  torsional  vibrations,  and  a  host  of  other  phys¬ 
ical  phenomena  which  are  significant  at  frequencies 
greater  than  30  rad/sec i  thus  the  design  model  (2)  is 
valid  only  far  law  frequencies.  This  fact  will  be 
important  when  designing  the  feedback  system. 

For  the  purpose  of  illustration,  a  hypothetical 
ac/dc  system  shown  in  Figure  1  is  used  throughout. 

A  physical  interpretation  of  the  dynamics  associated 
with  this  system  will  be  given  after  a  brief  discus¬ 
sion  on  the  methods  of  modal  analysis. 

II.  COMTROIAABIIJTr.  OBSERVABILITY  AMD  PHYSICAL 


Since  the  linearised  model  on  which  the  control 
design  is  based  has  limitations,  as  all  models  do,  it 
is  import ent  to  be  able  to  physically  interpret  the 
system  modes  in  order  that  the  control  system  design 
nay  be  evaluated  in  part  by  how  it  affects  them.  It 
fs  also  important  to  assess  beforehand  the  inherent 
ability  of  the  available  control  inputs  to  accomplish 
the  performance  objective  using  only  information  fur¬ 
nished  by  the  available  output  measurements.  This  is 
done  by  computing  the  open-loop  system  eigenvalues 
the  corresponding  left  and  right  eigenvectors,  deter¬ 
mining  what  each  mode  physically  represents  and  then 
determining  the  controllability  and  observability  of 


Wodal  Analysis 

To  facilitate  the  subsequent  discussion  on  the 
physical  interpretation  of  the  system  modes  the  role 
of  the  left  and  right  eigenvectors  of  the  system 
matrix  A  is  reviewed.  Consider  the  open-loop  system 

x(t)  -  Ax(t)  i  x<0)  -  Xp  O) 

where  the  eigenvalues  of  A,  1^,A2,...,XR,  are  assumed 
to  be  distinct,  bet  and  w*  be  the  right  and 

left  eigenvectors  respectively  of  A  associated  with 
the  eigenvalue  X^  and  define  the  matrices 

v  ■  [v^,Vj» . . . ,y^)  ca) 


. 2m,’-v‘l- 


A  «  diag[X1>X2,....XB)  .  ,  (8) 

Using  the  right  and  left  eigenvectors,  the  matrices 
A  and  eAt  may  be  written  as  dyadic  expansions: 


l 

i-1 


..  n  X.t  _ 

•  -  l  • 1  jusT  cm 

i-1 

The  unforced  response  of  the  system  is  now  given  by 


n  X.t  _ 
x(t)  -  l  (.  1 

i-1  ^ 


which  shows  that  x(t)  is  simply  a  linear  combination 


of  n  time- varying  vectors,  e  y, ,  or  modes  each 

j 

weighted  by  the  scalar  w^  x^.  A  physical  interpre¬ 
tation  of  a  right  eigenvector,  v^»  can  best  be  illus¬ 
trated  graphically  on  an  Argand  diagram  where  the 
components  of  v.  are  plotted  as  vectors  in  the  complex 

**  V 

plane.  The  quantity  e  v^  can  be  visualized  as 
rotating  all  components  of  at  the  same  rate 
ImtX1)  and  simultaneously  shrinking  or  expanding  them  at 
the  rate  exp{R* [X^t] }  depending  on  whether  X^  is  sta¬ 
ble  or  unstable.  This  is  similar  to  the  phasor  re¬ 
presentation  of  sinusoidal  signals  and  is  dspicted  in 
Figure  2. 

The  left  eigenvectors,  on  the  other  hand,  deter¬ 
mine  a  linear  combination  of  states  that  oscillate  at 
the  complex  frequency  equal  to  the  corresponding 
eigenvalue  since 


ft  f  w^x(t)}  -  mj  Ax(t)  -  X^{w*  x(t)> 


Physical  Interpretation  of 


The  open-loop  eigenvalues  of  the  system  are 
plotted  in  Figure  3.  The  Argand  diagram  associated 
with  each  of  the  four  pairs  of  complex  eigenvalues 
reveals  that  the  frequencies  of  certain  areas  are  ap¬ 
proximately  180*  out  of  phase  with  that  of  the  other 
areas.  This  is  interpreted  ss  an  electromechanical 
oscillation  in  which  two  coherent  groups  of  areas  for 
a  given  mode  swing  against  seek  other.  For  exempts, 
in  Figure  4  for  the  -.094+j3.80  modes,  the  aresai  and  2 
swing  egeinst  areas  3,4  and  S  with  areas  2  and  S 
being  dominant  in  the  oscillation.  Tha  two  remain¬ 
ing  eigenvalues  are  real.  For  the  eigenvalue  at  aero 
the  right  eigenvector  is 


vj  -  (1,0,1,0,1,0,1,0,1,01 


where  the  l's  correspond  to  angle  states  and  the  0's 
to  frequency  states.  The  physical  interpretation  is 
an  erbltrerv  ehase  reference  exists  for  this 


(14) 


Ax  »  A(x  ♦  0Vq) 

In  other  words,  only  ths  difference  in  Angle  states 
is  i sport ant  sines  any  constant  say  be  added  to  all 
the  angle  states  without  affecting  the  dynamic  res¬ 
ponse  of  the  system.  The  left  eigenvector  for  the 
resaining  soda  at  -.18  has  the  form 


where  is  the  intertia  of  area  i  divided  by  the 
total  system  intertia.  Equation  (12)  implies  that 

w(t)  »  ~.18u(t)  (16 


S(t)  m  v*  x(t)  -  l  B  «  (17) 

i-1  1  x 

is  interpreted  as  the  average  frequency  of  the  power 
system. 

The  foregoing  analysis,  clearly  demonstrates  the 
role  of  the  left  and  right  eigenvectors  in  determining 
the  physical  interpretation  which  may  not  be  immediate¬ 
ly  apparent  for  same  of  the  system  eigenvalues. 

The  left  and  right  eigenvectors  are  also  very  useful 
in  determining  the  controllability  and  observability 
of  the  modes. 

Modal  Controllability  and  Observability 

Consider  the  linear  system  with  m  inputs,  p  out¬ 
puts  and  n  states 

i(t)  -  Ax (t)  Bu(t) ,  x(0)  -  Xg  (18) 

X(t>  -  Cx(t)  .  (19) 

Using  the  variation  of  constants  formula  gives 


x(t)  -  e  jtg  ♦  y 


j(t>  -  Ce  x_ 


,A(t_t)Bu(T)dT 


CeA<t"T)8u(T)dt 


For  linear  operators  L(-)  and  H(*)  let  R  (L)  denote 
the  range  of  L(*)  and  N(H)  denote  the  nullspace  of 
H(*) .  The  system  defined  in  (18)  and  (19)  is  com¬ 
pletely  controllable  if  and  only  if 


/  eMt-T,.ui 


Bu(T)dT 


and  is  completely  observable  if  and  only  if 


if  the  state  of  the  system  can  be  driven  anywhere  in 

Rn  by  some  control  u(T)  applied  from  T-0  to  t. 
Analogously,  (24)  implies  that  given  the  output  jf(t) 
and  the  input  u(t)  for  0<T<t,  the  initial  state,  and 
thus  the  state  trajectory,  can  be  determined  or 
observed. 

There  are  different  ways  of  determining  whether 
the  conditions  (22)  and  (24)  are  satisfied.  However, 
the  definitions  of  controllability  and  observability 
specified  in  these  conditions  are  qualitative  con¬ 
cepts  and  do  not  provide  quantitative  measures  of  bow 
controllable  or  hew  observable  a  system  stay  bet  they 
can  only  say  what  part  of  the  system  is  controllable 
or  observable  and  what  part  is  not.  Part  of  theprob- 
lem  is  that  it  is  not  immediately  apparent  what  is 
meant  by  terms  like  "strongly  controllable"  or 
"almost  observable",  since  it  is  possible  to  define 
then  differently  depending  on  their  intended  use. 

One  possible  way  to  quantify  controllability  and 
observability  is  to  measure  the  change  with  respect 
to  perturbations  in  the  nominal  system  model.  In 
other  words,  if  "small”  perturbations  in  the  nominal 
system  change,  the  controllability  of  certain  states, 
those  states  would  be  considered  "weakly  controllable" 
or  "almost  uncontrollable." 

A  different  but  not  unrelated  way  of  measuring 
the  controllability  and  observability  is  based  on  the 
intuitive  idea  of  how  strongly  the  sodas  can  be 
excited  by  the  inputs  and  how  strongly  the  modes  ap¬ 
pear  at  the  outputs,  respectively.  This  is  made 
sore  precise  by  considering  the  original  qualitative 
definitions  of  controllability  and  observability  in 
terms  of  the  modes  of  the  system.  Consider  L(u)  and 
H(Xq)  in  terms  of  the  dyadic  expansion  for  exp  (At)  t 

L(u)  -  I  |e  1  4*]  /  elT  u(T)dx  (28) 


»<*o>  "  jjs i  5o  *  1  ][^i]  * 


From  (26)  it  is  clear  that  if  W^B-0  for  same  i, 

then  L(u)  is  a  linear  combination  of  at  most  n-1 
eigenvectors  for  any  u»  hence  dim  R(L)<  n  and  the  sys¬ 
tem  is  not  completely  controllable.  Similarly  from 
(27),  if  CVj-0  for  some  i,  then  IHVjj-O  but 

hence  dim  N(h)>  0  and  the  system  is  not  completely 
observable.  These  facts  are  Immediately  obvious 
once  g(t)  is  written  as 


- 

1-1  l 


T  T 

w.x  +  w  B 

-1-0  -i 


u(T)4T 


If  wTb»0  then  the  input  u  cannot  excite  the  1—  mods 
**  """ 

and  if  Cv  «0  the  1—  mode  does  not  appear  in  the 

"*  th 

output  £(t) .  In  these  cases  the  1—  mode  is  eaid  to 

be  uncontrollable  or  unobeervable  respectively.  If 
the  matrices  >  and  C  are  given  by 


N(H)  -  (0) 


•  “  e  e  e 


»<V  - 


c  - 


where  b^  is  the  i—  col  tan  of  •  and  c^  is  the  1— 
row  of  C  then  the  matrices  mb  end  CV  given  by 


) 


T,  T. 

*£l  2A 


bars  of  unit  hsight.  In  Figurs  6  ths  bar  heights  hava 
baan  scaled  column-wise  such  that  for  a  given  mode  the 
bars  of  the  input  and  output  from  which  the  mods  is 
most  controllable  and  observable  hava  unit  height. 
Notice  that  the  arbitrary  phase  reference  mode  is  not 
observable  from  any  frequency  output  but  is  control¬ 
lable  from  every  current  input.  Fran  both  Figures  S 
and  6  it  is  evident  that  the  most  observable  oscil¬ 
latory  modes  in  each  frequency  output  are  also  the 
most  controllable  from  the  input  of  the  same  area. 

This  has  important  ramifications  for  the  control  sys¬ 
tem  design  in  that  the  sensors  and  actuators  may  be 
colocated,  obviating  the  need  for  expensive  communica¬ 
tion  links . 


have  a  nice  interpretation:  the  magnitude  of  the 

T  th 

entry  w,b.  of  WB  measures  hew  much  the  j —  input 
“l— J 

of  u  affects  the  i —  mode  and  the  magnitude  of  the 

entry  cTv,  of  CV  measures  how  much  the  j—  mode  ap- 
th 

pears  in  the  i —  output  of  j  (t)  . 

If  the  rows  of  C  and  the  columns  of  V  are  normal¬ 
ised  to  have  unit  euclidean  length,  the  magnitude  of 

I 

c.v^  represents  the  cosine  of  the  angle  between  the  vec 

tors  c.  and  v.  Thus  when  £,  and  v.  are  nearly 

**  ^  *  **  ^ 
orthogonal  the  k-~-  node  is  unobservable  from  the  i — 

output  for  some  small  perturbations  of  the  nominal 

systms. 

In  interpreting  (31)  and  (32),  it  is  important 
to  keep  in  mind  that  the  magnitude  of  |  |w^b^  1 1  and 
|  |cjv_j  1 1  depends  an  the  choice  of  units  of  the  input 

and  output  as  well  as  the  scaling  of  the  eigenvectors. 
If  the  units  of  the  input  and  output  are  considered 


fixed, the  quantity  | Icv^J  |  can  only  be  made  large  by 
making  ||w?b||  small,  since  V-W  1  and  wjv^  -  6, 


Thus  it  seems  reasonable  to  balance  the  left  and  right 
eigenvectors  corresponding  to  the  same  eigenvalue  by 
making  their  norms  equal.  This  ensures  that  a  mode 
does  not  appear  very  observable  but  not  very  control¬ 
lable  or  vice  versa  only  because  of  the  scaling 
chosen.  It  is  also  worth  noting  that  the  matrix  prod¬ 
ucts  CV  and  MB  are  invariant  under  similarity  trans¬ 
formations  of  the  original  system,  and  the  tetans 

Cv,w%„  and  Cv,w*B  in  (2B)  are  independent  of  the 
-i~i-0  -i— i 


scaling  of  the  right  and  left  eigenvectors  as  long -as 

w-v'1.  For  the  power  system  model,  the  matrices  CV 
and  MB  (where  the  left  and  right  eigenvectors  are  bal¬ 
anced),  have  the  magnitudes  of  their  elements  plot¬ 
ted  on  bar  graphs  in  Figures  5  and  6.  The  bars  are 
plotted  in  pairs,  the  one  on  the  left  for  the  obser¬ 
vability  at  the  Indicated  output  and  the  one  on  the 
right  for  the  controllability  at  the  indicated  input. 
This  is  done  for  each  node  of  the  system.  In  Figure 
5  the  heights  of  the  bars  in  a  given  row  have  been 
scaled  such  that  the  most  controllable  and  most 

i— Am  :«•*  incut  and  output  have 


III.  LINEAR  QUADRATIC  REGULATOR  DESIGN 

The  basic  design  methodology  adopted  here  is  that 
of  using  a  linear  quadratic  regulator  to  obtain  a  first 
iteration  centralized  design  that  moves  the  open  loop 
poles  of  the  system  to  an  appropriate  closed  loop  pole 
region.  This  region  is  determined  approximately  on 
engineering  judgement  by  how  large  the  closed  loop 
bandwidth  stay  be  made  without  allowing  unmodeled  high 
frequency  disturbances  or  dynamics  to  destabilise  the 
system.  The  centralized  design  is  done  with  an  eye 
towards  later  decentralization  which  uses  only  the 
measurable  frequency  states.  The  decentralized  control 
law  then  attempts  to  mimic  the  centralized  control  law 
by  including  only  the  important  feedback  gains  from 
the  centralized  feedback  gain  matrix. 

Centralized  Design 

The  optimal  feedback  control  law  that  minimizes 
the  cost  functional 


J(fi>  -  /xT(t)Cx(t)+uT«t,*u(t),  5>0i  *>0  (33) 


is  given  by  the  familiar 
u‘(t)  -  -R_1BTKx(t) 


*T K+KA+fi  -  KBR-VlC  -  0  (35) 

under  the  usual  assumptions  that  (AiQ1^2)  is  detect¬ 
able  and  [A,B]  is  stabili sable.  The  state  weighting 
matrix  Q  is  selected  so  that  neither  the  real  average 
frequency  pole  nor  the  arbitrary  phase  reference  pole 
at  zero  are  sovtd.  It  is  not  desirable  to  move  the 
pole  at  zero  since  it  is  only  observable  from  the 
angle  states  which  are  not  measurable.  The  average 
frequency  pole  is  not  to  be  moved  since  the  load 
frequency  control  loop  is  to  control  that  mode.  The 
only  modes  that  are  to  be  changed  are  the  inter-area 
oscillatory  modes  since  they  require  significant  damp¬ 
ing.  There  are  at  least  two  ways  that  the  state 
weighting  matrix  Q  may  be  selected  to  do  this.  The 
first  method,  a  modal  one,  is  more  general  than  the 
second  method  which  depends  on  the  physical  inter¬ 
pretation  of  the  system. 

Nodal  Selection  of  P  Matrix 

Consider  the  dlagonalisation  of  the  system  (It) 
by  defining  a  modal  vector  »(t)  given  by 


z(t)  -  Mx(t) 

which  results  in 

s(t)  -  Aa(t)  ♦  MBu(t) 


i 


Alia  imaic  Aues  An  uia  seAectAun  wa  U  as  to 
only  thoaa  components  ot  £(t)  in  the  coat  that  Cor¬ 
respond  to  polea  of  the  open- loop  system  that  are  to 
be  aoved.  The  rest  of  the  Modes  of  the  systea  are 
aade  cost  unobservable.  Thus,  if  D  is  a  diagonal 
matrix  of  weightings  for  each  aode  than  (33)  becoaes 


J(fi) 


♦  uT  (t)Ru(t)dt 


(38) 


Note  that  the  term  | |o*(t) 1 |2  can  be  converted 

into  *T (t)Qx(t)  with  a  real  Q  matrix  in  the  following 
way.  Define  T  as 


r  -  dw  -  rR  +  jrx 


(39) 


then 

|  |ps(t)  1 1*  -  xT(t)wVwx(t)  -  xT(t)(gc(t)  (40) 

where 


average  frequency  deviation  weighting  for  the  i — 
area.  This  Q  only  weights  frequency  variables  so 
that  the  zero  pole  will  not  be  moved  and  since  only 
deviations  from  the  average  frequency  are  weighted 
the  average  frequency  is  used  as  a  reference  and 
hence  the  pole  at  -.18  will  not  be  moved.  Using  this 
method  also  requires  the  stabilization  ot  the  zero 
phase  reference  mode.  Therefore  in  the  centralised 
design,  ei  is  subtracted  fron  the  systea  A  aatrix  and 
is  used  as  the  system  aatrix  when  solving  the  Riecati 
equation  (3S)>  the  resulting  feedback  control,  however, 
is  applied  to  the  original  unstabilised  systea.  Both 
methods  of  selecting  Q  require  only  a  few  iterations 
of  selecting  modal  weightings  or  frequency  deviation 
weightings  to  obtain  the  approximate  damping  of  the 
oscillatory  modes  required.  It  is .interesting  that 
both  methods  give  approximately  the  saae  feedback 
gains.  The  centralized  design  that  is  used  throughout 
the  remainder  of  the  paper  is  based  on  the  weighting 
of  deviations  from  average  frequency.  It  should  also 
be  mentioned  that  the  control  weighting  matrix  R  was 
selected  as  the  identity  aatrix  multiplied  by  a  scalar 
to  tradeoff  state  and  control  energy. 


q  -  r!  r„  +  r*  rT  <«i> 

R  R  II 

There  is  a  slight  difficulty  with  this  method, 
however,  in  that  (*,()”  )  may  not  be  detectable. 

This  is  the  case  because  the  arbitrary  phase  reference 
aode  at  zero  is  aade  cost  unobservable.  One  way 
around  this  problem  is  to  use  a  reduced  model  that 
does  not  have  this  mode.  An  alternative  way  is  to 
artificially  stabilize  the  cost  unobservable  unstable 
modes  leaving  the  other  systea  modes  fixed.  This 
new  system  is  essentially  the  same  as  the  old  system 
for  the  purposes  of  design  of  a  feedback  controllar 
since  the  controller  will  not  attempt  to  stabilize 
the  unstable  cost  unobservable  modes.  This  is  ac¬ 
complished  utilizing  the  dyadic  expansion  of  the  A 

aatrix  in  (9) .  Let  A  be  the  artificially  stabilized 
^system  matrix  which  is  defined  by 


A  -  I  "  C  L 

101  ien 


2A 


e>o 


(42) 


where 


feedback  Structures 


In  order  to  describe  several  controllers  that 
result  from  modifications  of  the  centralized  control¬ 
ler  it  is  necessary  to  classify  several  different 
feedback  structures.  They  are  the  following: 

(1)  LQ  centralized  -  full  state  feedback 

(2)  LQ  Full  State  without  Angles  -  frequency  feed¬ 
back  only 

(3)  LQ  Major  -  local  area  frequency  and  frequency 
of  area  1  available  for  feedback  (the  major 
centralized  gains) 

(4)  LQ  Decentralized  -  only  local  are* frequency 
available  for  feedback. 

In  each  case  the  feedback  gain  for  the  controller 
structure  is  obtained  by  simply  setting  the  gains  in 
ths  centralized  gain  matrix,  that  correspond  to  states 
not  available  for  feedback,  to  zero.  The  cloeed-loop 
eigenvalues  for  cases  1,3  and  4  ars  given  in  Figure  7. 
To  assess  how  closely  each  of  ths  feedback  controllers 
mimic  the  centralized  feedback  controller  the  concept 
of  gain  observability  is  introduced. 


0  -  {i:  mode  is  unstable  and  cost 

unobservable}  ,  (*9) 

Now  the  matrix  A  has  the  same  eigenvectors  as  A 
and  the  same  eigenvalues  as  A  except  for  those  as¬ 
sociated  with  the  index  set  (1.  This  ensures  that  the 
old  and  new  system  will  behave  the  similarly  from  the 
standpoint  of  controller  design.  A  somewhat  simpler 
variation  of  this  approach,  which  works  if  €  is  suf¬ 
ficiently  small,  is  to  define  A  as  A-A-ei.  Then  A 
has  the  same  eigenvectors  as  A  and  eigenvalues  €  . 
away  from  thoaa  of  A. 

Avaraga  Frequency  Deviation  Selection  of  Q  Matrix 

The  second  method  of  selecting  the  state 
weighting  matrix  Q  la  to  weight  only  each  machine's 
or  area's  frequency  deviation  from  the  average  fre¬ 
quency.  Thus  the  state  weighting  la 

xT(t)Qx(t)  •  l  a.lw.-w)2  («*> 

_  i-1  1 


Gain  Observability 

The  ability  to  realize  a  centralized  feedback 
law  in  a  decentralized  manner  depends  critically  on 
the  nature  of  the  centralized  feedback  law.  It  may 
not  even  be  possible  if  the  centralized  feedback  law 
depends  substantially  on  states  not  available  for 
feedback.  Thus  only  nodes  observable  from  the  fre¬ 
quency  outputs  are  moved  in  the  centralized  design. 
Eliminating  gains  in  the  centralized  gain  matrix  that 
do  not  significantly  affect  the  feedback  la  commonly 
dona  by  satting  the  "small *  gains  to  saro.  Nhat  is 
considerad  "small"  must  be  considered  in  reference  to 
the  expected  size  of  the  variations  in  the  state. 
However,  it  la  not  always  clear  what  the  expected  vari¬ 
ations  ara  since,  in  general,  some  of  the  state 
variables  nay  not  be  physical  quantities.  Also,  while 
a  particular  gain  may  not  by  itsalf  be  insignificant, 
a  group  of  certain  gains  may  collectively  have  very 
little  effect  on  the  feedback  control  algnal  imple¬ 
mented  since  cancellation  of  the  contributions  of 
different  gain-state  products  may  occur  when  summed. 
This  later  idea  is  mads  precise  by  the  notion  ot  gain 
observability.  Gain  observability  merely  determines 


S 


the  *od»i  being  fedback  In  each  control  channel  by 
using  the  gain  Matrix  as  an  output  measurement  matrix 
and  computing  the  matrix  GV  where  G  is  the  gain  matrix 
and  V,  given  by  (4),  Is  the  matrix  of  right  eigenvec¬ 
tors.  .By  computing  GV  (or  different  gain  matrices  G, 
the  modes  being  fedback  in  each  channel  may  be  com¬ 
pared.;  This  is  done  in  rigure  6  for  the  four  feed¬ 
back  structures  previously  described.  From  rigure  6 
it  is  apparent  that  the  LQ  Centralised  and  LQ  Full 
State  without  Angle  feedback  caaaa  are  practically 
identical  indicating  it  is  not  important  to  try  and 
neasur$  the  angle  states.  The  LQ  Major  case  is  also 
guite  similar  to  the  LQ  Centralised  case  while  the 
LQ  Decentralised  case  is  somewhat  less  so.  Thus  gain 
observability  indicates  the  dominant  modes  in  each 
feedback  channel  and  provides  insight  on  how  to  cons¬ 
truct  a  decentralised  or  limited  state  feedback  con¬ 
troller  that  approximates  a  centralised  controller. 

As  a  matter  of  practical  importance,  each  control 
Signal  in  the  real  system  is  passed  through  a  washout 
which  washes  out  any  constant  frequency  errors  that 
may  be  generated.  The  washouts  have  a  transfer 

function  s»d  are  included  in  the  subsequent 

analysis  as  part  of  the  controllers. 

IV.  ROBUSTNESS 

In  any  control  system  design  there  is  a  degree  of 
uncertainty  about  the  model  parameters  and  about  the 
nature  of  the  disturbances  that  act  as  exogenous  in¬ 
puts  to  the  model.  A  well  designed  control  system 
must  be  able  to  tolerate  such  uncertainty  without 
destabilising  the  system.  Classically,  a  measure  of 
robustness  has  been  the  notions  of  gain  and  phase 
margin  for  SISO  feedback  systems.  In  the  multivari¬ 
able  version  of  the  Nyquist  stability  theorem,  the 
gain  and  phase  margins  do  not  provide  an  adequate 
measure  of  the  robustness  of  the  nominal  feedback  sys¬ 
tem  since  arbitrarily  small  simultaneous  perturbations 
in  the  nominal  system'mey  cause  instability  of  the 
closed-loop  system  even  though  there  are  good  gain  and 
phase  margins  in  each  feedback  channel. 

The  multivariable  Nyquist  criterion  counts  the 
encirclements  of  the  origin  by  the  det  (ItG(jbi))  where 
G(s)  is  the  loop  transfer  functions.  In  order  to 
Change  the  number  of  encirclesmnts  of  the  origin, 
det (I+G  (ju))  must  be  zero  for  some  u.  Thus  for  nom¬ 
inally  stable  closed-loop  systems  the  det (I+G)  tries 
to  measure  the  "distance*  of  I+G  to  the  critical  point 
but  is  not  a  good  measure  because  det (I+G)  nay  be 
very  sensitive  to  small  changes  in  G.  In  the  scalar 
case  det (I+G)  becomes  1+g  and  small  changes  in  g 
yield  only  small  changes  in  the  ttfquist  diagram  of 
1+g  or  g  so  that  this  problem  does  not  arise.  There¬ 
fore,  in  the  multivariable  setting  what  is  required 
is  an  insensitive  measure  of  the  "distance"  of  I+G  to 
the  origin.  The  minimum  singular  value  of  I+G  is 
such  a  measure.  It  aeasuraathe  minimum  size  of  the 
additive  perturbation,  AG,  required  to  make 
det(I+G+AG)-0  or  I+G+AG  exactly  singular.  The  min¬ 
imum  and  maximum  singular  values  are  denoted  as  g 
and  a  respectively  and  are  defined  by 


A  11*11, 

0(A)  ■  min  - 


«l*0  Hall, 


if  A  *  exists' 
(45) 


IM1»  A 

Hall, 


11*11, 


(46) 


nominal  system  that  will  make  the  closed-loop  system 
unstable.  It  has  been  known  for  some  time  that  linear 
quadratic  regulators  for  single  input-single  output 
systems  have  inherently  good. guaranteed  gain  and  phase 
margins,  of  namely  infinite  upward  and  50%  reduction 
gain  margins  and  +60*  phase  margin  (1).  This  is 
because  for  LQ  regulatoo  1 1+g  ( ju)  |»1  Vu  so  that  the 
Nyquist  diagram  of  g  must  avoid  the  unit  disk  centered 
at  (-1,0).  This  is  shown  in  Figure  9.  For  multi- 
variable  systems,  Kalman's  well-known  inequality  for 
LQ  regulators  (3,4)  generalizes  with  R>I  to 

(I+G(-s))T(I+G(s))>  f  Vs  (47) 

so  that 

0(I+G(Ju))>  1  VU  (46) 

is  analogous  to  the  scalar  case  where  |l+g(ju)) |>  1. 

It  has  more  recently  been  shown  (2]  that  for  diagonal 
RX)  and  Q>0  that  the  multivariable  LQ  regulators  have 
the  same  gain  and  phase  margins  in  each  feedback 
channel  simultaneously  as  in  the  single  input-single 
output  case.  Hcwever,  as  is  well  known,  the  infinite 
gain  margin  is  not  a  reality  for  the  real  world  be¬ 
cause  the  nominal  model  is  only  valid  within  a  limited 
frequency  range  and  furthermore  a  constant  feedback 
gain  at  all  frequencies  is  not  realizable.  Thus  the 
bandwidth  of  the  closed  loop  system  must  still  be 
checked  to  ensure  that  the  bandwidth  is  no*,  excessive 
and  that  the  loop  is  rolled  off  sufficiently  where 
unmodelled  dynamics  might  affect  the  closed  loop  sta¬ 
bility  of  the  system.  The  following  robustness 
theorem  checks  this  in  a  more  formal  way. 

Robustness  Theorem  [5,6] i 

Let  G(s)  be  the  transfer  function  matrix  of  a 
proper  finite  dimensional  linear  system.  Let  G(s)  be 
its  nominal  (design)  value,  also  proper  and  let 
AG^(s)  and  AGM(s),  defined  by  the  relations, 

G(s)  -  G(s)  +  Aga(s)  (49) 

G(s)  -  (I+AGM(S))G(S)  (50) 

be  such  that  C(s)  and  G(s)  have  the  same  number  of 
open-loop  poles  in  the  closed  right  halt  plane.  If 

the  nominal  feedback  system 

G(s)  (I+G(s)]-1  -  (I+G_l(s))"1  (51) 

is  stable,  then  the  perturbed  system 

G(s)  (I+G(s)]”^  (52) 

is  stable  for  all  perturbations  satisfying 

0(I+G(ju))>  o  (AG^(Jw) )  vu  (53) 

or 

£(I+G"1(ju))>  0(AGM(ju))  VU  .  (54) 

Alternatively,  the  conditions  (S3)  and  (54)  may  be 
replaced  by  (55)  and  (56)  respectively  given  as 


||(I+G(jw))‘l|fl> 

||aga()u)||  vu 

(55) 

I!(l+C"l(ju»‘1|f1> 

I|agm(}*»II  vu 

(56) 

where  1 1  •  1 1  denotes  the  1  or  m  matrix  norms. 


Therefore  if  at  seme  frequency  uQ,  0(1+G(ju))  is 
small,  there  exists  a  small  perturbation  in  the 
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subsequent  discussion  in  place  of  the  singular  values|7| 
To  test  the  robustness  of  the  modified  LQ 
controller  for  the  multiterminal  dc  system,  several 
plots  of  the  norms  specified  in  conditions  (55)  and 
(56)  have  been  computed  with  respect  to  different  per¬ 
turbed  models.  The  nominal  model  consists  of  the 
open-loop  system  regulated  by  the  LQ  major  controller 
modified. as  previously  described,  by  passing  the  con¬ 
trol  inputs  through  washouts  with  transfer  function 

to  eliminate  response  to  constant  frequency 

errors.  The  perturbed  model  is  the  same  as  the  nom¬ 
inal  except  that  it  includes  additional  filtering  of 
the  control  inputs  by  an  approximately  unity  gain 
double  pole  filter  at  s-25  to  simulate  the  additional 
phase  lag  of  torsional  filters  in  the  real  system. 

The  plot  for  the  multiplicative  perturbation.  Figure 
11,  shews  that  the  perturbed  system  is  stable  and  that 
the  nominal  system  has  a  degree  of  robustness  even 
beyond  the  perturbation.  It  is  interesting  to  note 
that  the  additive  perturbation.  Figure  10,  for  the 
same  perturbed  model  exceeds  the  nominal  at  the  system 
resonances.  This  points  out  the  fact  that  the  con¬ 
ditions  (55)  and  (56)  are  only  sufficient  but  not 
necessary.  Here  in  lies  one  of  the  major  wea)cnasses 
of  the  singular  value  approach;  it  is  sometimes 
unnecessarily  conservative.  In  Figures  12  and  13  the 
LQ  Major  controller  is  checked  for  robustness  with 
respect  to  a  perturbed  system  that  includes  an  ad¬ 
ditional  machine,  with  relatively  small  inertia,  that 
is  weakly  coupled  to  the  rest  of  the  system  to  model 
intra-area  dynamics.  The  resulting  changes  in  the 
closed-loop  system  eigenvalues  are  insignificant  even 
though  the  sufficient  conditions  indicate  there  does 
exist  a  perturbation  of  the  same  size  as  the  addition¬ 
al  intra-area  dynamics  that  will  destabilize  the 
system.  Notice  also  in  the  Figures  10  and  11  that 

1 1  (I+G)  1||  1  and  1 1  (I-fC  1)  1||  1  do  not  become  small 

at  any  frequency  which  is  indicative  of  robustness. 

To  make  the  connection  with  the  classical  SISO 
gain  and  phase  margins,  under  the  LQ  major  controller 
with  washouts,  one  of  the  system  feedback  loops  is 
broken .  The  margins  for  this  channel  are  an  infinite 
upward  gain  margin ,  a  gain  reduction  margin  of  loot 
and  a  phase  margin  of  +100  degrees.  This  also  gives 
an  indication  of  how  conservative  ths  norm  plots  may 
be,  since  they  take  into  account  perturbations  in  the 
system  that  may  not  be  reasonable.  Other  robustness 
norm-plots  for  the  completely  centralized  decentral¬ 
ized  case  are  similar  in  nature.  The  centralized 

case  has  the  largest  ||(I+G)  1||  1,  as  expected,  and 
the  decentralized  the  smallest. 

Another  method  of  evaluating  the  design  is  to 
break  feedback  loops  simulating  actuator  or  sensor 
failure  or  manual  intervention  and  check  the  stability 
of  the  resulting  system.  If  the  system  remains  stable 
under  the  breaking  of  feedback  loops  the  integrity  of 
the  system  is  said  to  be  maintained.  Even  though  a 
system  is  open-loop  stable,  this  does  not  guarantee 
the  the  closed-loop  will  remain  stable  when  feed¬ 
back  loops  are  broken.  Thus  it  is  important  to  check 
the  integrity  of  the  closed- loop  system.  For  the  LQ 
major  feedback  law  with  washouts  added,  the  system 
integrity  is  maintained  for  all  possible  combinations 
of  broken  feedback  loops.  The  same  is  true  for  the 
completely  decentralized  feedback  law  with  washouts 
also. 

Finally,  a  comparison  between  the  open-and  closed- 
loop  bandwldths  is  made.  In  Figure  14  ||G(ju)||,  the 

maximum  open- loop  frequency  response,  and 

||U+c'X(jw>r1||.  the 


out  the  resonances  in  the  open-loop  system  without  af¬ 
fecting  the  rest  of  frequency  response.  Control 
energy  is  not  wasted  ih  modifying  the  open— loop  system 
more  than  necessary.  This  is  related  to  the  perfor¬ 
mance  of  the  control  system  which  is  discussed  next. 

V.  CONTROL  SYSTEM  PERFORMANCE 

Evaluation  of  the  closed— loop  system  performance 
is  done  by  examining  the  system  transient  responses 
and  feedback  control  inputs  to  the  system  generated 
by  an  initial  condition  corresponding  to  the  state 
vector  for  the  open— loop  system  after  the  clearing  of 
a  three-phase  ground  fault  at  area  4.  Figure  IS 
shows  the  angle  of  area  4  using  area  3  as  a  reference 
(i.e.  6^-Sj)  for  the  open-loop,  the  LQ  centralized, 

LQ  major  and  LQ  decentralized  designs  with  the 
washouts  in  place.  Figure  16  shows  the  corresponding 
frequency  for  the  same  initial  condition  and  con¬ 
trollers. 

As  can  be  seen  from  these  figures,  all  the  con¬ 
trollers  give  approximately  the  same  performance  in 
the  transient  responses.  They  significantly  reduce 
the  settling  time  of  the  inter-area  oscillations. 

These  responses  are  typical  of  all  the  angle  and  fre¬ 
quency  transient  responses.  However,  the  control 
inputs  for  the  various  controllers  are  distinguishable. 
Figure  17  displays  the  control  signal  u2  for  the  three 

different  controllers,  again  with  the  washouts  in 
place.  As  can  be  seen,  the  centralized  feedback  gain 
uses  the  least  control  energy  indicating  a  coordinated 
control  effort.  The  decentralized  controller,  as 
expected,  use  the  most  since  it  lacks  information  to 
yield  a  coordinated  effort.  The  effect  of  the  com¬ 
munication  of  the  frequency  of  area  one  to  all  other 
areas  can  be  assessed  in  terms  of  the. difference  in 
the  control  energy  for  the  LQ  siajor  and  LQ  decentral¬ 
ized  cases . 

VI.  SUMMARY 

In  this  paper  some  of  the  fundamental  concepts 
of  linear  system  theory  are  exploited  to  gain  a  better 
understanding  of  the  internal  dynamics  of  the  system 
and  how  it  is  related  to  the  external  environment. 

It  is  shown  how  the  right  and  left  eigenvectors  help 
physically  interpret  the  response  of  the  system  at 
different  outputs  when  excited  from  different  inputs 
making  use  of  the  concepts  of  modal  controllability 
and  observability.  A  method  for  selecting  the  state 
weighting  matrix  to  relocate  only  specified  modes  is 
given.  The  concept  of  gain  observability  is  utilised 
in  comparing  different  feedback  structures,  with 
limited  state  feedback,  with  the  centralized  full 
state  feedback  controller.  It  is  seen  through  simu¬ 
lation  that  the  cost  of  a  decentralized  feedback 
structure  is  that  more  control  energy  is  required  to 
damp  out  oscillations  due  to  the  loss  of  communica¬ 
tion  of  important  information.  The  controllers  are 
shown  to  be  robust  with  respect  to  model  uncertainty 
by  use  of  multivariable  and  classical  robustness 
measures.  The  integrity  of  the  system  is  also  main¬ 
tained  in  the  face  of  all  possible  actuator  or 
sensor  failures.  These  considerations,  that  the 
practicing  control  engineer  must  take  into  account  in 
the  design  of  a  practical  control  system,  are  illus¬ 
trated  in  this  design  and  its  evaluation.  It  is 
Important  to  emphasize  that  the  multiterminal  dc  con¬ 
troller  design  is  based  on  a  linearised  modal  and 
does  not  consider  large  signal,  nonlinear  phenomena 
such  as  converter  node  switching.  These  are  topics 
for  future  research. 
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figure  ii  Open-loop  Eigenvalues  with  Mon negative 
Imaginary  forte. 
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figure  12  s  Robustness  for  Additive  Perturbation 
of  Additional  Intra-Area  Dynamics. 

